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SECTION 1 
INTRODUCTION 



This report describes the results of w he 3-year evaluation study 
of the seven Special Emphasis projects funded by the US Office of 
Education (USOE) • 

STUDY OBJECTIVE 

General Research Corporation (GRC) contracted to conduct a 
process and impact evaluation of the Special Emphasis Project for the 
Office of Evaluation and Dissemination (OED) of the USOE. 

The purposes of the process evaluation were to examine the degree 
to which each Special Emphasis project adhered to USOE project guidelines, 
to determine the comparability of students in the Special Emphasis and 
comparison schools, and^to describe the characteristics of each Special 
Emphasis instructional program* 

The purpose of the impact evaluation vias to determine the impact 
of the Special Emphasis Program on reading performance of students in 
the project school?^ as contrasted with reading perforoance of students 
in the comparison schools, to investigate changes in reading-related 
attitudes and behaviors, and to document the residual effects of each 
Special Emphasis Program. 

SUMMARY OF STUDY CONCLUSIONS 

The working hypothesis of the Special Eii?)hasis Project was that 
intensive programs of reading instruction introduced at an early age 
would effect significant improvement in patterns of reading achievement 
in schools having large numbers of low achieving students. The data 
collected and analyzed from the seven project sites for this evaluation 
study reveal that Special Emphasis sites themselves can be classified 
according 'to the degree to which they implemented the Special Emphasis 
concept and program. Of the three sites with the highest implementation 
ratings (Louisiana, Tennessee, and Texas), two showed evidence of impact 
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favoring Special Enq)hasis student groups. The data suggest that program 
implementation had a determining influence on program success and conse- 
quently on student performance. Of the sites achieving lower implementation 
ratings (Michigan, Ohio, West Virginia, and California), significant 
differences between Special Emphasis and comparison student groups were 
scattered between the two student groups. Because it is questionable 
that Special Enq)hasis was in fact operationalized at these four sites, 
the few instances of impact favoring Special Enq)hasls groups cannot 
be construed as evidence of program success. 

Highly operationalized Special Emphasis programs had two program 
features in common. Reading specialists worked in the classroom teaming 
with the regular classroom teacher and inservlce training programs 
attempted to integrate and reinforce a diagnostic-prescriptive approach 
to reading instruction. 

Sites which exhibited the greatest degree of carry over of Special 
Emphasis concepts and practices when Federal project funds terminated 
were those with the highest implementation ratings. The greatest degree 
of carry over w.'is experienced at the classroom level. Key factors 
associated with the integration or adaptation of Special EnQ)hasis program 
features at individual project sites were: an interest and prominent 
role by the local education agency in the project, recognition of Special 
Empha*iis as a unique intervention effort, and a sense of accomplishment 
and involvement on the part of teachers and reading specialists in the 
project. 

ORGANIZATION OF THE REPORT 
This report contains: 

• A discussion of the background of the Special Emphasis 
Project and the evolution of this evaluation study. (Section 2) 

• An examination of the study design and methodology applied 
to the analysis of study data. (Section 3) 



• A description of the seven Special Emphasis projects and 
discussion of process findings. (Section 4) 

• A discussion of impact findings for each of the seven 
project sites. (Section 5) 

Volume II of this report contains a description of the standardized 
reading test used in the evaluation, correspondence to project sites 
regarding data collection activities and requirements, and study instru- 
ments. 
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SECTION 2 
BACKGROUND 



THE SPECIAL EMPHASIS PROJECT 

The Right to Read Special Emphasis Project was initiated under the 
provisions of Public Law 94-380, Section 721, as amended by Public Law 
94-194, Section 10. This legislation authorized the USOE to undertake a 
study to test the hypothesis that intensive programs of reading instruc- 
tion introduced at an early age can change the patterns of reading achieve- 
ment of students in schools having large numbers of students reading one 
or more grades balow level. Unlike many educational interventions intend- 
ed to be remedial programs, e.g.. Title I of the Elementary and Secondary 
Education Act, Special Emphasis was to have a preventive focus. In this 
respect. Special Emphasis was to take a diagnostic-prescriptive approach 
to reading instruction with all students in grades 1 and 2 and provide 
remedial attention to students in grades 3 through 6 who were reading 
below level. 

The major provision of the authorizing legislation called for the 
implementation and evaluation of Special Emphasis projects which pro-, 
vided for: 

• The teaching of reading by reading specialists for all 
children in grades 1 and 2. 

• The teaching of reading by reading specialists for 
elementary school children in grades 3 through 6, who 
have reading problems. 

• An intensive vacation reading program for elementary 
school children who are reading below the appropriate 
grade level or who ar experiencing problems in learn- 
ing to read. 

For purposes of the Special Emphasis program, the terms "reading 
specialist," and "reading teacher" were defined in the Title VII legis- 
lation as; 
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"Reading Specialist" means an individual who hai. a 
master's degree, with a major or specialty in reading 
from an accredited institution of higher education 
and has successfully completed 3 years of teaching 
experience which includes reading instruction. 

''Reading Teacher" means an individual, with a bachelor's 
degree who has successfully completed a minimum of 12 
credit hours, or its equivalent, in courses of teaching 
reading at an accredited institution of higher educa- 
tion and has successfully completed 2 years of teaching 
experience which includes reading instruction. 



In addition to the major program features identified above, the 
authorizing legislation listed 14 specific features to be included in the 
Special Emphasis Project funded by the Office of Education (OE) . These 
14 features were: 

• Diagnostic testing designated to identify pre-elementary 
and elementary school children with reading deficiencies, 
including the identification of conditions which, without 
appropriate other treatment, can be expected to impede 

or prevent children from learning to read. 

• Planning for and establishing a comprehensive reading 
program. 

• Reading instruction for elementary school pupils whose 
reading achievement is less than that which would 
normally be expected for pupils of comparable ages and 
in comparable grades of school. 



Preservice training programs for teaching personnel in- 
cluding teacher-aides and other ancillary educational 
personnel, and inservice training and development 
programs, where feasible, designed to enabl- ?uch per- 
sonnel to improve their ability to teach 3 a.^ nts to 
read to the extent practicable. 

Participation of the school faculty, school board mem- 
bers, administration, parents, and students in reading- 
related activities which stimulate an interest in read- 
ing and are conducive to the improvement of reading 
skills. 

Parent participation in development and implementation 
of the program for which assistance is sought. 



Local educational agency school board participation in 
the development of programs. 



Periodic testing in programs for elementary school 
children on a sufficiently frequent basis to measure 
accurately reading achievement; for programs for pre- 
elementary school children, a test of reading pro- 
ficiency at the conclusion, minimally, of the first- 
grade program into which the nursery and kindergarten 
programs are integrated. 

Publication of test results on reading achievement by 
grade level- and, where appropriate, by school, without 
identification of achievement of individual children. 

Availability of test results on reading achievement on 
an individual basis to parents or guardians of any 
child being so tested. 

Participation on an equitable basis by children en- 
rolled in non-profit private elementary schools in the 
area to be served (after consultation with the appro- 
priate private school officials) to an extent consistent 
with the number of such children whose educational needs 
are of the kind the prog'-nm is intended to meet. 

The use of bilingual educational methods and techniques 
to the extent consistent with the number of elementary 
school-age children in the area served by a reading 
program who are of limited English-speaking ability. 

Appropriate involvement of leaders of the cultural and 
educational resources of the areas to be served, in- 
cluding institutions of higher education, non-profit 
private schools, public and private non-profit agencies 
such as libraries, museums, educational radio and 
television, and other cultural and education resources 
of the community (to the extent practicable). 

Assessment, evaluation, and collection of information 
on individual children by teachers during each year of 
the pre-elementary program, to be made available for 
teachers in the subsequent year, in order that con- 
tinuity for the individual child not be lost. 



^ The USOE further specified the purposes and objectives of the 
Special Emphasis Program in its definition of terms and the provisions 
to be used in identifying the specific student populations the program 
was intended to serve. The most Important of these definitions were: 
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• Reading deficiencies — Reading achievement which is 
less than that normally expected for children of 
comparable grades of school. For children in grades 
2 through 8, reading deficiency is defined as reading 
ability 1 or more years below appropriate grade levsil 
as estimated by standardized tests and/ or informal 
testing. 

• Reading problems^ -Reading achievement which is less 
^ than would normally be expected for children of 

comparable ages in comparable grades. 

• High perce ntage of children with reading deficiencies— 
Fifty percent or more of the students in grades 2 
through 8 reading 1 or more years below appropriate 
grade level. 

• Intensiv e reading instruction — Inatrurtlnn in reading 
that would provide pupils with a minimum of 20 to 30 
minutes of direct teacher-pupil Interaction each day 
and 15 to 20 minutes per day of independent reinforce- 
ment activities. A total of 40 minutes of reading in- 
struction per day was stipulated. 

In planning for the implementation of the Special Emphasis Project, 
the USOE planned a controlled experiment in which each school in which 
the Special Emphasis "treatment" was to be implemented would be matched 
with a "comparison" school which was slmilrvr with respect to: 

• Instructional approaches 

• Curriculum materials 

• Size of enrollment 

• Student characteristics (socioeconomic status, ethnicity, 
and average scores oh standardized tasts) 



The provisions of the legislation required that each applicant for 
a Special Emphasis Program grant provide assurance that: 

• Appropriate measures have been taken by the agency to 
analyze the reasons why elementary school children 
are not reading at the appropriate grade level. 
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The agency will develop a plan setting forth specific 
objectives which shall include the goals of having 
the children in project schools reading at the appro- 
priate grade level at the end of grade three. 

Whenever appropriate, sufficient measures will be 
taken to coordinate each pre-elementary reading pro- 
gram with the reading program of the educational 
agencies of institutions which such pre-elementary 
school children will be next in attendance. 



Further, the USOE regulations specified that local education agencies 
(LEAs) participating in the Special Emphasis Project would be required to 
assure that: 

• All first and second graders would receive intensive 
reading instruction. 

• All students in grades 3 through 6 who have reading 
problems would be given intensive instruction in 
reading. 

• An. intensive summer program would be available for the 
project school students who are performing below grade 
level, and this service not be available to the com- 
parison school children. 

• Instructional plans would be formulated through con- 
sultations with many parties, including the district 
administration, parents, and faculty of the project 
school, and that this plan would include a diagnostic- 
prescriptive approach and be part of a comprehensive 
reading program in the project school. 

• Cooperation be extended with an external evaluation to 
be conducted by the Commissioner or his/her contractor. 

Fifty applications for Special Emphasis Project funding were re- 
ceived by the USOE. These applications were evaluated by the criteria 
stipulated in Section 162.41 of the 'regulations (see Table 2.1). In 
the initial screening process, 30 applications were found to be techni- 
cally ineligible. From the remaining 20 applications, 8 were selected. 
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TABLE 2.1 

CRITERIA FOR EVALUATING SPECIAL EMPHASIS PROJECT APPLICATIONS 



Section 162.41: In reviewing applications under this subject, the 
Coxmnisaioner will seek to identify a small number of high quality proj- 
ects and will apply the following criteria and point system totalling 
175 points: 

(a) The soundness of the proposed plan of operation, including 
consideration of the extent to ^rtiich: 

(1) The objectives of the project are sharply defined., 
clearly stated, and capable of being measured £^nd 
evaluated (20 points) ; and 

(2) Provision is made for inservice training appropriate 
to the needs of the project (10 points); 

(b) The over«JJL quality of the instructional, design including: 

(1) The extent the project plans promise an effective 
instructional climate (15 points) ; 

(2) The quality and comprehensiveness of plans for improv- 
ing the tAole school reading program (15 points) ; 

(3) The extent plans for the sxsmaer school are integrated 
with the overall school reading program (10 points); 

(4) The adeqxiacy of the diagnostic program to identify 
students with reading p^'oblems and needs (10 points); 
and 

(5) The extent the project will utilize recent research 
fxindings and provide for the adoption of innovative 
products and practices (10 points) ; 

(c) Provision is made for the sole use of reading specialists 

or reading teachers, rather than regular classroom teachers, 
under the conditions set out in 162.39(b) (50 points); 

(d) The qualifications of the project director (15 points) ; 

(e) The reasonableness of cost in relation to anticipated 
results (10 points) ; and 

(f) The quality of the proposed management design that includes 
process evaluation, schedules, and resource utilization 
plans (10 points). 
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Each of the eight projects funded for the first year of the pro- 
ject— 3.976-77— received between $100,000 and $200,000 per year, an amount 
approximately twice the amount expended (on a per-pupil basis) under 
Title I of the Elementary and Secondary Education Act. 

The first year of the Special Emphasis Project was marked by late 
startups, ongoing program adjustments, and a working out of relationships 
between reading specialists and classroom teachers. The second year of 
the study, school year 1977-78, was characterized by more "normalized" 
operations. Staff relationships were established and signs of integra- 
tion of Special Emphasis into the ongoing system began to appear. 

During the second project year, six of the original sites were re- 
funded. These sites were located in Louisiana, Michigan, Ohio, Tennessee, 
Texas, and West Virginia. An additional site, located in California, 
was added to the project, giving a new total of seven projects for the 
1977-78 school year. The Ohio project had to be dropped from the eval- 
uation following the 1977-78 school year because of large-scale court- 
ordered shifting of students involved in the study. 

THE EVALUATION OF SPECIAL EMPHASIS 

Concurrent with the funding of the Special Emphasis projects, the 
USOE contracted for the evaluation of the project with an outside con- 
tractor. The contractor/evaluator for this project was to conduct both 
a process and an impact evaluation of the Special Emphasis Project. 

The evaluation contract for the first phase of the Special Emphasis 
Project was awarded to Applied Management Sciences, Inc. (AMS) . During 
the first 18 months of this evaluation, AMS completed the following major 
activities: 

• ^ Development of the initial study design. 

• Development of the data collection instruments and selection 
of the reading test to be used as the instrument for assess- 
ing reading achievement. 

22 
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• Supervision of the testing of students in the fall of 1976 
and the spring and fall of 1977. 

a Data collection in spring, summer, and fall of 1977. 

• Preparation of the first annual Special Emphasis Project 
report including: background on the development of Special 
Emphasis; a description of the methodology; site profiles; 
and analysis of variance for student gains, using pre- and 
postmeasures and a Special Emphasis-coniparison school model. 

The first year of the evaluation of the Special Emphasis Project 
W5S hampered by several factors which affected subsequent project impi.e- 
mentation and, ultimately, had an important effect on the evaluation of 
the impact of the Special En?)hasis Projects. Among these problems were: 

• Project grants were not awarded until several months Into 
the 1976-77 school year. This delay caused difficulties In 
program implementation and resulted in the loss of valuable 
instruction time for Special Emphasis. 

• The local education agencies were occupied most of the first 
year with the process of Implementing project requirements. 
In addition to the normal "shakedown cruise'' associated with 
new programs, some sites experienced intra-staff tensions 
owing to the required introduction of reading specialists 
into the daily routine of the classroom teachers. 

• The original study design contained no provisions for in- 
cluding student demographic or treatment data in the impact 
analysis. 

• The fall 1976 data could not be identified by individual 
students. Therefore, pre- and postmeasures could not be 
matched on a student-by-student basis, and the analysis had 

' to be limited to grade lev^^l aggregation. 
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• Staff from some comparison schools felt that they were 
being imposed upon by the data collection efforts without 
due consideration for their role. This perceived lack of 
consideration contributed to a lack of cooperation and, 
therefore, lack of uniformity in the data collection process. 

In April 1978, GRC was awarded the contract for the continuation of 
the Special Emphasis evaluation project. Under this contract, GRC: 

• Augmented the site profiles developed by AMS through the 
collectl of data on the demographic characteristics of 
students and measures of intensity of instruction. 

• Conducted data collection at local sites in the spring, summer, 
and fall of 1978 and 1979, using instruments designed by AMS 

as supplemented by data collection forms designed by GRC. 

• Developed standardised written instructions and procedures 
for the administration of the Stanford Diagnostic Reading 
Test (SDRT) and the completion of the data collection instru- 
ments. 

• Supervised testing in the spring and fall of 1978 and 1979. 

• Created a longitudinal data base by merging the data collected 
in 1978 and 1979 with the data collected in 1977 by AMS. 

• Conducted data analysis for the second annual report and the 
final report of the Special Emphasis Project. 

GRC was assisted in this project by Americas Corporation, its subcontractor, 
which participated in data collection activities at four sites. 

The evaluation design and methodology applied to the collection and 
processing of study data is described in the next section. 
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SECTION 3 
EVALUATION DESIGN AND MKTHnnnT.nf:v 



OVERVIEW 

The purpose of the Special Emphasis Evaluatioii was to examine 
the process of delivering the Special Emphasis Program and to determine 
the impact of the Program on participants. This required the design 
of a study with process and impact components. 

The objectives of the two study components are listed below. 
Process Evaluation 

• Examine the degree to which the project sites adhered 
to the Special Emphasis Project guidelines— inclusive . 
of those specified in the authorizing legislation and 
those established by the USOE. 

• Determine the comparability of schools and students in Special 
Emphasis and comparison schools. 

• Describe the charact:eristics of the Special Emphasis school 
year instructional programs and the summer reading programs. 

The process -valuation of the Special Emphasis Project was based 
on data and information collected from classroom observations, question- 
naires, and interviews. Data and information used in the process 
analysis included both instructional programmatic data and data on 
student and staff characteristics. 

Impact Evaluation 

• Determine the impact on reading performance of students 
in the Special Emphasis and comparison schoola during 
each school year and over the length of the study. 

• Determine differences in the retenticr. of reading skills 
between schools with and without sum reading programs. 
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• Determine the impact of the Special Emphasis Program on 
reading-related attitudes and behaviors of school staff, 
students, and parents, 

• Document the residual effects of the Special Emphasis 
Project within each participating school district and 
on project participants. 

The impact evaluation of the Special Emphasis Project was designed 
as a longitudinal, controlled experiment in which differences in reading 
performance of students who participated in the Program was compared 
to reading performance of a similar group of students who did not 
participate. 

DESIGN CONSIDERATIONS AND LIMITATIONS 

Social science researchers have long recognised the difficulty 
of conducting . :..,a controlled experiment in the real world. The 
problem of conducting such an experiment over an extended period of 
time— especia; - .n multiple schools— is, in many ways, the most compli- 
cated of all longitudinal, controlled experiments. The general problems 
of conducting such studies are well documented in the literature, 
were well recognized by USOE at the time this evaluation study was 
planned, and were understood by the contractor in the design of the 
study and the development of the data analysis plan. 

The experience gained in the conduct of the Special Emphasis 
Project evaluation does, however, offer some important insights into 
the methodological problems of conducting evaluations of longitudinal, 
multi-site experiments in educational settings. 

The major constraints and complications encountered in tht: conduct 
of this study may be summarized under three general topics: 

• The design and implementation of Special Emphasis. 
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• Study instrumentation. 

• Implementation of the data collection. 

The Design and Imp lementation of Special Emphasis 

The Special Emphasis Program was initially developed as a quasi- 
experimental design. While intended to be a "treatment-comparison" 
group study, neither the USOE nor the evaluation contractor had the 
authority to exercise control over any of the several major variables 
crucial to the conduct of a controlled experiment. 



With respect to the legislative specifications and the guidelines 
which were developed, all Special Emphasis sites appeared to be in 
compliance regarding: 

• Hiring of additional staff—reading specialists/teachers 
and teacher aides. 

• Use of reading specialists/teachers who met USOE guidelines. 

• Use of a diagnostic-prescriptive approach to reading instruc- 
tion. 



• Provision of summer reading programs. 

There was, however, a wide disparity between sites regarding 
com<>liance with other USOE guidelines. In several instances, these 
deviations from USOE guidelines resulted in the introduction of condi- 
tions which violated basic tenets of experimental research. 

Table 3.1 identifies some of the most significant factors over 
which there was not cur-nlete control, (in fact, at the time the Special 
Emphasis Project contracts were awarded, all recipient districts were 
out of compliance with the requirements of the law and the USOE regula- 
tions on at least one major issue.) 

While some of these variables might have been controlled by 
the application of alternative procedures in the selection of treatment 
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TABLE 3.1 



SUMMARY OF CONDITIONS AND FACTORS WHICH 
IMPEDED THE TREATMENT-COMPARISON GROUP DESIGN 



The nature and extent of the Special Emphasis ''treatment" 
were only generally defined, allowing progrannnatic latitude in 
the design of the individual projects. Participating districts 
were permitted to adopt their own instructional strategies — a 
provision which severely restricted cross-site comparisons, 

Reading specialists and special reading programs which 
existed in the comparison schools at the time Special Emphasis 
projects were initiated were allowed to remain while they 
could be removei from the treatnent schools — a provision 
which confounded the experiment and severely restricted com- 
parisons both within sites and across sites. 

Participating districts could not be restricted from 
introducing new, or expanding existing, related reading 
programs, such as those funded under the provisions of Title I, 
in the comparison school. 

Participating districts could not be restricted from 
adding staff, aides, volunteers, etc., in areas other than 
reading, in the con?)arison school; this altered the overall 
teacher /student ratio. 

Major differences existed in the Special Emphasis and 
comparison schools with respect to size, ethnicity, teaching 
methods, and pretest scores. In some instances, comparison 
schools offered more intensi-ve reading instruction than the 
Special Emphasis schools. 

Criteria for selecting students for participation in 
the Special Emphasis Program varied across sites. 

Special Emphasis Project standardized reading tests 
were administered at the treattaent and comparison schools at 
approximately the same time as their own reading achievement 
testing program thus introducing the possible confounding 
variables of the "practice effect" and/or "ov. . testing." 




and compariaon schools, some of the conditions which characterized— or 
aifferentiated between— the treatment and comparison schools were altered 
during the course of this longitudinal study by actions of the participat- 
ing local education agencies. 

An advance awareness of all the trf^atiaent-comparison school 
chr.racteristics and variants might enable a contractor to design a 
research plan which would control for some of the most important con- 
founding variables. However, it is most probable that an experiment 
of a larger scale than the Special Emphasis Project wou],d have been 
required to obtain definitive evaluation results. 

Problems resulting from factors such as those listed in Table 3.1 
could, in future studies, be overcome and/or compensated for by: 

• Providing greater specificatiou as to the treatment to 

be provided and the means by which such treatment is pro- 
vided. Such a provision would at least euGure programmatic 
consistency and would- in this case, have allowed for 
an evaluation of the Special Emphasis Project as a whole 
rather than limiting the evaluation to independent evalua- 
tion of individual project sites. 

• Limiting the changes which could be made in the educational 
programs of the participating schools during the period 

of the experiment. Such a provision would reduce the 
number of confounding variables introduced and enhance the 
degree to which findings of significance can be attributed 
to the experimental treatment variable. 

• Increase the size of the experiment to provide a data base 
of sufficient size for the influence of potentially con- 
founding variables to be factored out in the process of data 
analysis. 

The measurement of program impact for the summer Special Emphasis 
program as originally designed, presented analytical problems which 
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could not be overcome. The original evaluation study contractor did 
not provide for the identification of matched tre^itment-coraparison 
groups. With the concurrence of the project officer, the investigation 
of summer program impact on reading retention was aborted. Tho issues 
which led to this decision are presented later in this section. 

Study Instrumentation 

Two major types of data were required to perform the process 
and impact evaluations required in this study: 

• Data and information about the teachers and the student 
popu3.ations in the participating schools and educational 
practices employed in these schools. 

• Data to be used in assessing the impact of the Special 
Emphasis Projects on the students and schools where these 
projects were implemented. 

In several cases, a single instrument was used to collect data, 
for both of these purposes. Instruments used in this study, and the 
evaluation component for which data in each instrument was used, are 
summarized in Table 3.2. 

(Copies of all instruments used in this study are contained 
in Volume II of this report.) 

Several problems were associated with the evaluation instru- 
mentation used in this study. Specifically, the analysis of study 
data was constrained by: 

• The reading test selected to measure achievement. 

• The omission of data elements important for analysis, 
e.g., student demographic data. 
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TABLE 3.2 
STUDY INSTRUMENTS AND USE(S) 



Inscrumftnt 



I- 

2^ 

3. 

4^ 

5^ 

6> 

7. 

8- 

9. 

10 > 

U> 

b. 

I~ 



Th« Stanford Diagno stic Reading fsc (SORT) 



Tha Claaalficacion of T^^ghln f ^ Practices 
JProjact Director Quaatlonnalra 



Exparlaattal School Principal Qu»g tlonnalra 



Comparlaon School P rincipal Quaatlonnalra 
Raadlntt Specialist qua«cioTina<i-> 



Experimental School ClaaarooHi Teacher questionnaire 



Use of Data 
Process 
Sttfdy 



Comparison School Classroom Teacher Questionnair e 
Librarian Questionnaire 



Student rCrade 3) and SniAV-, ^ (Grades 4-6) Questionnaires 
Parent Questionnaire 



Student Infonaaclon Chjic\cligg 



Classroom Observation Protocol 



The Stanford Diagnostic Reading Test (SDRT) was selected by 
the original evaluation contractor because (1) it provided a diagnostic 
instrument which coulc^ be utilized in the Special Emphasis Program; 
(2) it was designed to be particularly sensitive to the skill domain 
performance of below average reading achievers; (3) it facilitated 
tracking of student progress through all elementary grades, because 
its multiple levels yielded con?)arable scores across all grades; and 
(4) as a recently revised test, teachers in the experiment would not 
likely be inclined to "teach to the test." These features notwith- 
standing, a number of characteristics of the SDRT clearly rendered the 
test inappropriate for purposes of this study: 

• As stated in the test manual, the SDRT is intended primarily 
as a diagnostic test; it is not designed for use as an 
achievement test. 




• As a diagnostic test, the SDRT Is designed for use in 

the identification of the readino' problems of: low achievers. 
Accordingly, it yields a highly _ d negative distribution 
and does not discriminar.e well at the hi? i end of the 
scale. Thus, the SDRT's ability to measure achievement 
and detect differences in performance between Special 
Emphasis and comparison cohorts where either groups* mean 
raw scores were above the 70% level was limited.^ 

As a diagnostic test, the SDRT was intended for aoministra- 
tion in the fall of the school year and is normed on the 
£lass level for use in placement. While the publishers 
nave provided norming information for individual students 
for spring testing, the fact that the test is even easier ' 
for students in the spring further exacerbates the ceiling . 
effect problem discussed in Voli.me II and documented in 
Appendix C. 

• Because the SDRT was not normally used by school systems 
both teachers and students were aware that they were parti- 
cipating in an evaluation project, whether they were receiv- 
ing Special Emphasis or not. 

The use of the SDRT as the evaluation instrument for this study 
is further complicated by the general provisions of the Special Emphasis 
Project. Specifically, while treatment schools were required to provide 
Special Emphasis reading instruction to all first and second graders. 
Special Emphasis reading instruction for students beyond second gr:ade 
was mandated only for those students reading one or more grades below 
level as measured by whatever reading achievement test was normally 
used by the participating schools. There is, however, no basis for 
assuming that performance levels measured by the SDRT corresponded 



^The 70% level as a point of potential ceiling effects was suggested 
by one of the test authors. Dr. Bjorn Karlsen. 
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to achievement levels on tests used by the participating schools to 
identify students for Special Emphasis instruction beyond grade 2 
in the individual schools where chis experiment was conducted. Thus, 
the results of this study may be biased by program assignments made 
on the basis of the results of tests used by participating schools. 

A second data limitation relates to the adequacy of data necessary 
for the analysis of program impact. The data collection instruments 
used in the first year data collection by the origiaal study contractor 
contained no provisions for the collection of demographic information 
on students in the Special Emphasis and comparison schools. The study 
instruments used in the first year's data collection also made no 
provision for identifying those students in grades 3 through 6 who 
had received Special Emphasis. 

These limitations were corrected by means of the Student Informa- 
tion Checklist designed by GRC aad used in the collection of data 
for school years 1977-78 and 1978-79. An examination of data secured 
from the spring 1978 Student Information Checklist gave evidence, 
however, that reliable student-by-student participation data could 
not always be provided by classroom teachers. Procedures for the 
collection of these data were subsequently revised, but it was not 
until the 1978-79 project year that these data were collected with 
acceptable reliability. As a result, the ability to analyze program 
impact by isolating the treatment variables by student was impossible 
for all but the final y»ar. 

Implementation of the Data Collection 

The research plan for the evaluation of the Special Emphasis 
Project called for the collection of data which could be used to identify 
test scores by student, grade, class, school, and project site. To 
preserve student anonymity, the initial study contractor developed 
a 10-digit identification code~4 digits of which were used to identify 
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individual students— to be used on all test forms and student question- 
naires. This coding system, explained in a brief letter from the 
contractor, was sent out prior to the initial data collection in fall 
1976. 

Several months after GRC assumed responsibility for this study, 
data tapes from 1976 and 1977 were obtained. In the course of examining 
these tapes, it was found that a significant number of the test forms 
did not contain a full 4-digit code to identify students and that, 
in numerous instances, more than one student had been assigned the 
same identification number. These errors in coding and verification 
prevented data from the fall 1976 data collection from being linked, 
by student, to the spring 1977 data. As a result, it was necessary 
to eliminate from the analysis the data collected during the first 
round of testing. 

The limitations in the data collection procedures revealed by 
the analysis of the initial contractor's data tapes were generally 
overcome by the implementation of more stringent coding and qualiLy 
control procedures in the second and third years of this study. 

Having Identified these coding errors, GRC established a procedure 
for correcting these codes and improving the capability to link student 
test scores over time. During spring 1979, each project site was 
given a complete testing history for each student through fall 1978 
and asked to verify the accuracy of the birthdate and sex associated 
with the 4-digit ID code. As a result, many errors were resolved, 
preserving as much data as possible for the analysis. 

It should be noted that the corrections that were made relate 
only to errors which could be identified through the application of 
basic editing and consistency checks. Not all the errors which might 
have existed in the identification numbers could be identified using 
the procedures employed in this analysis. The diligence of the respec- 
tive Special Emphasis staffs notwithstanding, one should not assume 
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that this process has produced 100% accuracy, given the limited control 
which GRC had over the data verification and the correction process. 

For the study results to be as representative as possible of ' 
Special Emphasis participants, it was necessary to collect both pretest 
and posttest SDRT scores for as many participants as possible. The 
extent to which this objective was met was limited by sample attrition 
due to: 

• High student mobility at some project sites. 

• Absenteeism on testing dates. 

• Errors in coding SD2T answer booklets. 

The SDRT test history for each :Jite contained in Appendix A provides 
the data necessary to calculate sample attrition. 

A complete discussion of data collection procedures is contained 
in Volume II.. 

DATA ANALYSIS STRATEGIES 

The analysis plan developed by, GRC expanded and enhanced the 
plan initially developed by the previous evaluation contractor. The 
analysis activities paralleled the two study components— process and 
impact. 

Process Anglysis 

The process analysis is primarily descriptive. The first step 
was to compare the aggregate characteristics of the Special Emphasis 
and comparison schools at each site. Among the characteristics con- 
sidered were: 

• Student enrollment 

• Racial/ethnic mix of student body 

• Sex designation of students 

• ' Percent of students receiving free or reduced-price lunch 
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The purpose of this comparison was twofold: to assess the adher- 
ence of each Special Emphasis project to the implementation guidelines 
concerning comparison schools and to evaluate the degree of confidence 
to be placed on the assumption of effective "randomness" for the iaipact 
analysis . 

The second step in the process analysis was to provide a descrip- 
tion of the teaching techniques, resources, and the intensity of instruc- 
tion for both the Special Emphasis and the comparison schools. Data 
from the teacher questionnaires, the Classification of Teacher Practices 
instrument, the Student Information Checklist, and the Observation 
Protocols were used to profile each of the schools within the seven 
Special Emphasis projects. 

These citta were helpful in assessing adherence to Special Emphasis 
guidelines. They also contributed to the interpretation of impact: 
results through recognition of the environmental and treatment factors 
that influence the study outcomes. 

Impact Analysis 

The primary purpose of the impact analysis is to assesf' the 
reading performance of students who participated in Special Emphasis 
in relation to similar sfru^ents who did not participate. In addition, 
GRC. investigated the possibility of other project outcomes such as 
changes in reading-related attitudes and behaviors and residual effects 
of Special Emphasis. The SDRT questionnaire, and interview data were 
utilized in this investigation. GRC anticipated assessment of impact for: 

• Project years 1977-78 and 1978-79 

• The full length of the project, 1977-79.^ 

• Each of the summers 1977, 1978, and 1979, for which the 
Special Emphasis summer program were in operation. 



^As we noted earlier, the test data from fall 1976 were excluded from 
the analysis because of major coding problems and sample attrition. 
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The measure used to assess reading performance was the comprehen- 
sion total score on the SORT, The comprehension total score is a 
composite score derived from two subtests. A description of the various 
subtests for each test level of the SORT is provided in Volume II. 
The comprehension total „as chosen since it coiunon to all test 
levels administered and was believed to provide an approximate measure 
of achievement rather than diagnosis. 

Project Year Analysis 

The project year analyses cover the period from the spring testing 
of the previous year to the spring testing of the project year under 
study. A multidimensional approach was utilized to examine impact 
in terms of statistical significance and, more inportantly, in terms 
of educational significance. 

With the concurrence of USOE, the project .aam decidpd to: 

• Consider each project site as a separate eva uatLon. 

• Examine reading performance for each grade separately. 

The analysis of students aggregated by grade, by site was accom- 
plished through use of Analysis of Covariance (ANCOVA). Because of 
the presumed presence of measurement error in the observed test scores, 
a comparison of the mean observed change between the Special Emphasis 
and comparison cohorts could give a distorted view of the true condition.^ 
Therefore, the dependent variable used was the students' scaled scores 
on comprehension total for the spring of the project year under study. 
The independent variable was the treatment given, either Special Emphasis 
or comparison. The covariate used to statistically adjust the dependent 
variable was the pretest comprehension total scaled score. 



^F. M. Lord. "Elementary Models for Measuring Change," Problems in 
Measuring Chanf^e , C. W. Harris (ed.), Madison: University of Wisconsin 
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ANCOVA permits analysis of groups that are not equal with respect 
to the covariate(s) as though they were equal. However, there are 
several assumptions that must be satisfied to pudu^t statistically 
valid results. In particular, the assumption that each Special Emphasis 
group and its corresponding comparison group are drawn fiom a single 
population and any initial differences can be consideied as random 
error require examination. 

This assumption was met to varying degrees at each of the seven 
project sites. Therefore, ANCOVA was more appropriate for some sites 
and grades than for others. An additional influence on performance' 
may relate to demographic differences between corresponding groups, 
■^erefore, GRC also performed ANCOVAs using composite variables which 
included demographic variables and the pretest as covariates. These 
analyses did not, however, shed any additional light on the significance 
Jf the impact of Special Emphasis. 

Presented with the ANCOVA results in Appendix E and F are esti- 
mates of growth in terms of grade equivalents. The mean pre- and 
posttest scaled scores were converted to appropriate grade equivalents 
and the mean observed change was calculated. While this analysis 
can result in a built-in bias in favor of the initially low-scoring 
group, it is presented as an extension of the ANCOVA and provides 
a yardstick to measure growth against expectations with respect to 
national norms. Although generally, a 1 year change in grade equivalent 
would be expected or "normal" growth. Dr. Bjorn Karlsen, an author 

of the SDRT, proposes that this expectation is unreasonable for low 

2 

achieving students • He presents evidence that a .6-.? average growth 



^Lord, p. 37. 
2 

B. Karlsen, "Accountability - A Year's Growth in a Year?" The California 
Reader, Vol. 5, No. 1, January 1972. 
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rate for the lowest 25% would be a loore reasonable expectatioti. There- 
fore, while it may appear that low-scoring groups are losing ground 
with respect to normal expectations, a program may produce educationally 
significant results with growth rates of less than 1 year to lower 
achieving students. 

The covariar'ie analyses were applied to two cohort groups: 

• Whole grade cohort groups at each Special Emphasis and 
its comparison school. 

• Lower achieving student groups, i.e., those students below 
the mean pretest score for their grade cohort groups. 

The whole grade analysis was within the scope of GRC's original analysis 

plan. The below mean analysis was added to investigate program inQ)act 

on those participants for whom Special Emphasis had been targeted. 

In addition, tlie study team was intterested in determining whether 

or not the results of this analysis supported the results of the whole 

grade cohort analysis. 

Several hazards are associated with the use of ANCOVA for below 
mean cohort groups lliese are listed below and readers are advised 
to consider these limitations when reviewing the analytical results 
presented in Section 5 of this report. 

• The proportion of students scoring below the grade mean 

in Special EnQ)hasis and comparison groups may not be equal. 

• The below mean cohort group for both Special Emphasis 
and comparison groups exhibit a preponderance of negative 
measurement error at the low end of the distribution. 

Length of Project Analyses 

To evaluate the impact of Special Enq)hasis over the length of 
the project, spring 1977 to spring 1979, two types of analyses were 
conducted. First, subgroups by site, by grar^e, were developed consisting 
of only those students with SDRT test scores for the spring 1977 and 
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spring 1979 test points. The analysis of each of these subgroups was 
similar to the ANCOVA and the estimate of grade equivalent growth 
employed for the project year analysis. Due to sample attrition over 
the length of the study, only whole grade cohort groups were analyzed. 

A second approach taken to investigate the impact of Special 
Emphasis over the duration of the project focused on students reading 
1 or more years below grade level. It was based on an examination 
of trends relative to changes in the percentages of students reading 
1 or more years below expectation. 

Frequencies were tabulated for each spring testing of: 

• The nudber of students tests for each grade. 

0 The number of students reading 1 or more years below grade 
level for each grade. 

From these data, the percent of students reading 1 or more years below 
grade level was calculated. These data are contained in tables for 
each site Ifi Appendix D* 

Summer Program Analyses 

The impact analysis of Special Emphasis summer reading programs 
on reading retention presented special design problems. As originally 
designed, the study was to compare reading performance between studen\:s 
attending summer school and students at comparison schools without 
a summer program. Scores on the SDRT administered to both groups 
in the spring and fall were to be analysed for differences in perfor- 
mance. Two facts necessitated dropping this investigation from 
the evaluation plan. 

• r articipation in Special En5)hasis summer reading programs 
was voluntary. By electing to participate, program par- 
ticipants constituted a unique group for which no comparison 
group could be identified. 
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• Ttie reading test used to measure performance in this study 
is normed on an individual student basis only for spring 
administra::ion and on a class and individual basis for 
fall s;jministration. 

GRC attempted to override these problems by opting to conpare the 
participant's performance with the individual student noma established 
for spring and fall testings. However, pervasive cailing effects 
encountered on test scores prevented this analysis for producing valid 
and reliable results. A discussion of ceiling effects and their implica- 
tion for this study is contained io Appendix G. 

The preceding section addressed the major design and methodological 
features of thi,- C:Valuation study and factors which limited the effective 
implementation and evaluation of Special Emphasis. While the real 
world conditions in local school systems do not provide the consistency 
and comparability necessary for a perfectly controlled experiment, 
the Special Emphasis experience illustrates that adjustments and correc- 
tive actions can be taken to provide insight to the impact of alterna- 
tive treatments within the real world setting. 

Complete results for the process and impact analyses of the 
Special Emphasis Project are reported in Sections 4 and 5 . Appendix G 
of this report contains further discussion of evaluation methodology. 



3-17 



SECTION 4 
THE SPECIAL EMPHASIS PROGRAM 



INTRODUCTION 

Special Emphasis was mandated by Congress as an experimental 
intervention to improve the teaching- learning process for children 
likely to experience difficulty in learning to read. Accordingly, 
the evaluation of Special Emphasis sought to assess: 

• The implementation of the concept a^d/ requirstnents of 
Special Emphasis as it was intended by Congress and the 
USOE guidelines. 

• The character and the quality of the instruction-learning 
process . 

• The outcome, or the effects, of the intervention, given the 
variables of student characteristics, instructional resources 
and facilities, and instructional methodologies. 

The following discussions describe the implementation and the 
program features of Special Emphasis. The first part of ehis section 
provides a site-by-site analysis of the findings. These analyses are 
foUowed by a cross-site analysis of the seven local projects included 
in the study. 

The following topics are discussed for each of the sites: 

• Background— The community setting in which the project took 
place together with sone of the major factors which influenced 
the initiation and implementation of Special Enqjhasis . 

• Project Schools— A description of the characteristics of 
the experimental and comparison schools, the staff, the 
students, and the regular reading programs. 

• • The Special Enq)hasis Program— A description of the program, 

including the objectives, staffing, instructional processes, 
use of materials, provisions for inservice training, compli- 
ance with project guidelines, and special features and conditions, 
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Summer Prograa — The major features of the vacation school 
instruction and related activities* 

Site Summary — The strengths and weaknesses of the local 
projects . 

The cross-site analysis which follows the site-by-site descriptii 
provides a synthesis of project implementation, instructional processes 
and management provisions within the network of projects. 



• 
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LOUISIANA 



Background 

The Louisiana site lies in a rural area located 30 minutes driving 
distance from the nearest medium-sized tovm. The off-shore oil boom 
In the area is introducing rapid change to this community. The change 
has been accompanied by an influx of itinerant workers, settlement of 
highly trained, professional persons, and new employment opportunities. 
The main sources of income for the bayou area residents are sugar and 
sugar-related industries. Because this is a seasonal activity, the 
wage base for the area is severely curtailed; consequently, the school 
population is stable, but poor. 

Project Schools 

There were four schools involvevl in the Special Emphasis Project 
in Louisiana. The school district has divided its r;tudent population 
into buildings serving grades 1 through 3 and grades 4 through 8. At 
this Special Emphasis site, both the treatment and comparison populations 
were each located in two buildings. 

Enrollment characteristics for school year 1977-78 and 1978-79 
are sunmiarized on Table 4.1. The treatment and comparison schools in 
Louisiana were equal in terms of student demographic characteristics. 
However, there was considerable difference in the size of these two 
populations, the comparison group being more than twice as large. 
Although the higher enrollment at the comparison schools required a 
correspondingly higher number of teachers, the average class size in 
the comparison school exceeded the average class size in the treatment 
school by 9 students in 1977-78 and 4 students in 1978-79. 

Table 4.2 provides a comparison of staff characteristics at the 
treatment and con?)arison schools for the 1977-78 and 1978-79 school 
years. Shifts in the percentage of teachers with graduate degrees 
and the average number of years of teaching experience were due to a 
norcial process of staff turnover. In addition to the regular teaching 
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TABLE 4.1 
ENROLLMENT CHARACTERISTICS 

Site: LOOISIANA 



Schooi,: 


Special Emphasis 


Comparison 


Project Year: 


1977-78 


1978-79 


1977-78 


1978-79 ' 




301 


304 


724 


715 


By Sex: 










Male 


51% 


50% 


48% 


49% 


Female 


49Z 


50% 


52% 


51% 


By Racial/CLhnic CatGgoriea: 










Black 
White 
Hispanic 


58% 


56% 
41% 


52% 
47% 
1% 


50% 
49% 
1% 


Other or uncategorized 


1% 


2% 


* 


* 


Students Receiving Free or 
Reduced-Price Lunch 


54% 


53% 




45% 


Students for Whom English 
is a Second Language 


3% 


5% 


* 


1% 


Students Absent More 
Than 25% 


1% 


3% 


62 


4% 

i 



Rounding estimates are responsible for column totals below or above 100%. 
Less than .5% 



TABLE 4.2 
STAFF CHAF^CTERISTICS 

Site: LOUISIANA 



School; 


SpaciaX E&^haaia 


Cooparljoxi 


Projecn Ta*r: 


1977-78 


1978-79 


1977-78 


1978-79 


NiB^er of TMchftr« 


12 


12 




25 


TeAchers with Giraduat* Degrees 


17% 


27% 


25% 


15% 


Average Teacher Experience 


9 yrs. 


12 3rrs. 


10 yrs. 


8 yrs. 


Average Number of Students/Class 


25 


25 


34 


20 



staff, all sc'iools at this site had a librarian, nurse, speech and read- 
ing specia-Ust, counselor, and social worker. A physical education 
te.3Jher served the treatment school; a music teacher was at the com- 
parison school. 

One Title I reading specialist and one aide were assigned to 
each school at this site. Students who qualified under Title I guide- 
lines received up to 45 minutes per day of extra reading instruction 
at both treatment and comparison schools. In the treatment schools, 
the extra assistance these students received was coordinated with the 
regular classroom instructional program. This linkage did not exist 
at the comparison school. The Precision Teaching System was used for 
Title I in both schools. This system is a machine-assisted approach 
to teaching and practicing basic reading skills. The reading specialist 
worked with small groups or individuals, introducing skills and direct- 
ing their learning experiences. Students practiced independently 
recording their work on scoring cards. These cards were machine scored 
ar.d each student's skill attainment was recorded. Aides in the Title I 
labs supervised practice sessions with small groups, scored tests, and 
kept records. The Precision Teaching System was developed by the 
Special Emphasis project director. 

A conparison of instructional time (excluding Title I) between 
schools reveals marked differences. First graders at the treatment 
school received a total of 120 minutes reading instruction daily; 90 
minutes of this was Special Emphasis. At the comparison school, first 
graders received 90 minutes of reading Instruction. Second and third 
graders at all schools receiviid 90 miimces of daily instruction. At 
the treatment school, 60 minutes of this time was provided by Special 
Emphasis. Comparison school students, grades 4 through 6, had 15 minutes 
more of instruction each day (75 vs. 60 minutes). Students, grades 4 
through 6, at the treatment school received no additional instruction 
beyond the 60 minutes per day of Special Emphasis. Thus, except for 
first grade, the comparison schools offered an equal or greater amount 
of reading instruction than the treatment schools. 
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Facilities and materials at treatment and comparison schools were 
well matched at this project site* The Houghton Mifflin basal reading 
series was used at all schools. The Houghton Mifflin series is a highly 
structured program featuring the sequential presentation of reading 
skills organized by behavioral objectives. The accompanying assessment 
tests (magazine levels) permit teachers to periodically measure student 
progress and skill mastery. Alternative instructional strategies and 
practice activities are provided for teachers to address skill deficiencies. 

Both treatment and comparison schools had adequate audiovisual 
equipment and other instructional equipment and aids, such as tape 
recorders, overhead projectors, listening stations, teaching labs, and 
language masters. However, these aids received only minimal use, 
except in the Title I and Special Emphasis labs, where they received 
moderate use. The major difference between Special Emphasis and com- 
parison schools was in instructional grouping of students. In 1977-78 
over half (67%) of the teachers in the Special Emphasis schools con- 
sidered small group instruction a major strategy versus less than 20% 
in the comparison school. Use of small groups and individualized 
instruction decreased in both schools in 1978-79 to 55% in the Special 
Emphasis school.** and 4% in the comparison schools. 

With respect to teaching orientation, an analysis of the Classifi- 
cation of Teaching Practices (Table 4.3) indicates that a majority of 
teachers in both Special Emphasis and comparison schools tended to be 
structured rather than flexible. Wliether through staff turnovers or 
attitude shifts, a greater percentage of teachers in the Special Emphasis 
schools, however, was less structured during the final project year 
than in the comparison schools. Similarly, more comparison school 
teachers took a more diagnostic-prescriptive approach during the final 
project year. As a group, the Special Emphasis teachers tended to be 
less structured and more diagnostic-prescriptive than their comparison 
counterparts. 
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TABLE 4.3 
CLASSIFICATION OF TEACHING PRACTICES 



SlC« .■ LOUISIANA 



1 

Teaching 
Orlaacation 


1977-78 


1Q7S-7Q i 


Spaclal 
Enphasls 


Cooparlsoa 




Spaclal 
aohaals 




xson 


Dianosclc Approach 




N 


JLl 


JL 


i! 


N 




Dlagnoadc- 
Praacrlpclva 


4 


31 


7 


35 


4 


36 


9 


41 


Edactlc ^ 


9 


69 


4 


20 


6 


55 


7 


32 


Hhola Claaa 


0 


0 


9 


45 


1 


9 


6 


27 


Hanasacanc Stvla 
Struccurad 


10 


83 


17 


85 


7 


58 


17 


77 


Edactlc * 


1 


8 


3 


15 


3 


25 


5 


23 


naxLbla 


1 


8 . 


0 


0 


2 


17 


0 


0 







Baaad on tha uuabar of daaarooo ccachars raaponding. 

^■'tHrlf**'^'"' "EcUcclc" tndtcc. a fchlag orlenc.Cion which confine. .i.b»„cs 
from both approaches or scylaa. wii»/xuc« «i.cnKnc3 



The Special Emphasis Program 

The overall objective of the Special Emphasis Program was to 
increase the percentage of students reading at grade level from 14% to 
50Z based on the California Teat of Basic Skills. The second meAor 
goal was to determine the factors conttibuting to poor reading achieve- 
ment and develop teaching methods to overcome these factors. All 
students, grades 1 through 6, were served by the Special Emphasis 
Program at this site. 
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Prolect Staff 

The Special Emphasis Project was under the supervision of a 
project director who divided his time between the administration and 
implementation of Special Emphasis and the Title I project. Although 
he was not a full-time employee of the school district, he was recog- 
nized by project staff for his educational leadership and for providing 
operational guidelines and materials for their instructional program. 

4-7. 

9^ 



Also assigned to the project were three reading specialists, all 
of whom had master's degrees and a minimum of 10 years' teaching experi- 
ence. Each specialist served two grade levels, 1 and 2, 3 and 4, or 
. 5 and 6. One aide assisted each specialist with small group instruction 
and record keeping. Aides were trained 42nd supervised by the reading 
specialists. A part-time secretary /clerk served the project's needs. 

The Special Emphasis Treatment 

According to local project policy, all students in grades 1 through 
6 were served by the Special Emphasis Program in Louisiana. Table 4.4 
shows enrollment and program participation data for project years 1977-78 
and 1978-79. As noted. Special Emphasis provided 90 minutes of instruc- 
tion for first grade students, 60 minutes were provided for students 
in grades 2 through 6. 



TABLE 4.4 

TREATMENT GROUP SIZE BY GRADE LEVEL* 



51t«: LOUISIAMA 





Pro-(«et Ymfi^ 1977-78 


Pro1«ct 


Yajir 1978*79 




TOtAl 

EnroIIaant 


Z Sftrvtd By 

SpeclAl Enphuls 


Tocal 
Enro linen t 


Z Smtvmd By 
Special ErnhMM-Ln 




50 


100 


58 


100 


Gradft 2 


39 


100 


38 


100 


GTMdm 3 


50 


100 


47 


lOQ 


Grudft 4 


58 


95 


54 


100 


Gradft 5 


52 


100 


47 


100 


Gr«a« 6 


52 


100 


60 


100 



Based on Experimental School Principal Oueatlonnal: 



49 
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Specia ^hasis instruction took place in the reading specialist's 
lab-type classroom with the specialist, classroom teacher, and aide present. 
Glasses, averaging 25 students, were brought tc the reading room and 
divided into groups according to reading ability and skill needs. Each 
group then rotated through a series of activities. In general, the 
reading specialist conducted instruction, the teacher provided follow-up 
and practice activities, and the aide supervised oral reading or inde- 
pendent work. The roles of the teacher and aide shifted according to 
teacher preference. A listening station provided a fourth activity in 
the specialist's room. 

Teachers, reading specialists, principals, and the project director 
were involved in planning the reading program at the treatment schools. 
Specialists and classroom teachers indicated that they reviewed student 
progress and jointly planned their instructional activities on a weekly 
basis; their dual teaching assignment offered them the opportunity to 
communicate daily. While the specialists clearly took the lead, there 
was an effort during the final project year to shift instructional 
responsibilities back to the classroom teachers. 

Use of Materials 

Throughout the first year. Special Emphasis utilized the materials 
of the Precision Teaching System. Diagnostic quizzes, teaching strate- 
gies, and materials keyed to each of the 5000 identified reading skills, 
and evaluation quizzes were the core of this system. Automatic scoring 
machines provided immediate feedback to student and teacher. This 
program, however, was also used for the school district's Title I 
program. For the second and third years of Special Enphasis, the Pre- 
cision Teaching System was used exclusively in Title I labs. With 
the reading specialist responsible for the basic inatructional program 
in 1977-78 and 1978-79, the basal reading series (Houghton Mifflin), 
along with published and teacher-developed skill activities, were the 
major teaching resources used in Special Emphasis. 



Inservlce Training Program 

A practical site-specific series of inservice training programs 
was offered to classroom teachers, specialists, aides, and principals. 
In 1976-77, the focus of the training was on analyzing the district- 
adopted basal reading series (Houghton Mifflin) to determine its appro- 
priateness for the student population. Where the basal materials were 
found inappropriate, alternative strategies and materials were devised. 
Sessions were led by the project director. A local university recognized 
these sessions as an extension course and offered participants 3 hours 
of credit. 

In 1977-78 and 1978-79, inservice training was conducted by the 
project director and a reading specialist. Participation was open to 
principals, teachers, specialists, and aides. The instructional focus 
of this training was on the implementation of a diagnostic-prescriptive 
approach to instruction, the selection of appropriate materials, and 
the interpretation or student assessment data. Wliile academic credit 
was not offered, 52% (1978) and 64% (1979) of the classroom teachers 
attended inservice training and they rated the sessions "very helpful*' 
(on a scale of not helpful, somewhat helpful, very helpful) . 

Summer Program 

In 19 78, the Louisiana project conducted a 20-day summer program 
serving approximately 170 students. This number represented over half 
of the project school's total enrollment, grades 1 through 6. Four 
reading specialists and four regular classroom teachers, serving as 
aides, were employed. In addition, two high school students regularly 
volunteered their services and an average of six parents accompanied 
the students on weekly field trips. 

The objectives of this program were: 

• To counter the regression of reading skills during the 
no-school, summer months. 

• To foster language development. 

• To provide remedial instruction^^ sub-grade-level readers. 
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Reading specialists handled four classes each day, providing 
instruction in 50-minute time blocks. In addition to the 50-minute 
reading class, each student had 50-minute periods of library, arts and 
crafts, and films and a 10-minute recreation break. The program operated 
from 8:20 AM to 12:30 PM. 

The Houghton Mifflin basal series and Precision Teaching System 
for reading, which were the mainstays of the regular school year reading 
program, were used during the summer. Word and reading-related games 
were integrated into the summer instructional program. 

Coordination of the summer and regular school year programs was 
accomplished through the use of identical commercial materials. No 
system for measuring student gains was built into the summer program. ■ 
The role of the school principal during the summer was twofold: super- 
vise instruction and maintain discipline. The project director super- 
vised the operation of the overall program and provided technical 
assistance as needed. 

In 19 7S, the staffing configuration in the summer program was 
changed to include four reading specialists, three teachers, and two 
teacher-librarians. Four aides from the school-year program were 
assigned to the summer program; three assisted teachers and one worked 
with the librarians. Teachers who had served as aides the previous 
summer were responsible for conducting reading classes in 1979. No 
volunteers were involved • At the. conclusion of the stjmmier program, 
the Special Emphasis reading specialists assisted principals in setting 
up reading groups for the coming school year. Table 4.5 provides a 
summary of the 1978 and 1979 summer program statistics. 

Compliance with Special Emphasis Guidelines 
The following discussion examines features of the Louisiana 
project in light of the project guidelines listed in Section 2, Back- 
ground • 




TABLE 4.5 
SUMMER PROGRAM SUMMARY 



sttm totJisiAm 



Profm Duradon 
Boors p«r d^y 



tr 1978 



4.0 
4.0 



SuaPT 1979 



4,0 
4.0 



lascroectonal hours in rssdlng 
sad rssdlat-rslscsd scclvltlss 
(boors psr dsy) 



2.0 



2.0 



tocaX School XaroUasnc 



301 



School SaroUasnc 



170 



160 



Psrcspc of tocsl Soroll»mt 



tsschsr/Adult-Scudsnc Bsclo 



56 



1:21 



53 
1:12 



Bssdlng Spsdsllscs 

tssehsrs 

Aldss 

Librsrlsns 
Oya/Art Tsschsr 
Voluatssrs 



4 

0 

4(resiilar ceachfirs) 

0 

0 

2<studftats) 
6(par«aca, Friday 
only) 



4 
3 
4 
2 
0 
0 



Voltatssrs not indudsd in coiBputlag Teschsr/Adult-Studsnc Ratio* 
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A staff of reading specialists served the project schools. All 
students 5 grades 1 and 2, were served by Special Emphasis staff. All 
third through sixth grade students were also served by the program, 
thus extending service beyond the level specified in the guidelines. 
Instructional periods also exceeded guideline requirements. However, 
students in grades 4 through 6 at the comparison school had 15 minutes 
per day more instructional time than those at the treatment school. 
A summer reading program was provided and was well attended. Inservice 
efforts at this site consisted of presentations by the project director 
and a reading specialist. While funds to support academic course work 
were provided in the project budget, staff reported participation in 
accredited inservice training only in 1976-77. Planning of the reading 
program included district administrators, the project director, reading 
specialists, and teachers. Because reading specialists provided the 
basic reading instructional program for all grades in the treatment 
schools, classroom teachers actually had little to say in the planning 
and delivery of the program. Some effort to shift the responsibility 
for instruction back to the classroom teacher was made as the project 
neared its conclusion. 

Diagnostic testing was conducted and used as a guide for grouping 
students for reading instruction. Achievement tests were administered 
per.tcJically by the school district to measure student progress. Test 
results were made available for conferences with interested parents 
or guardians of individual students. No special activities to stimulate 
interest and improvement in reading were conducted. 

Louisiana's skill mastery record keeping system utilized the 
Precision Teaching System and Houghton Mifflin basal reading series. 
However, neither of these systems can be attributed to Special Emphasis. 
Comparability of the schools involved in this study was compromised by 
the size of the two populations — the student body and staff at the 
comparison schools was twice that of the treatment schools. 
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Project personnel extended their cooper ition to the evaluation 
study team. As specified in Appendix G, coding problems in Louisiana 
caused delays in the data reduction process and contributed to a loss 
in student test and survey data and parent survey data. Table 4.6 
reports the response rates for the various evaluation study instruments 

The Louisiana site was in compliance with the Special Emphasis 

guidelines, with two exceptions: the size of the treatment and compari 

son populations, and the lack of a reading motivation component in 
Special Emphasis. 



TABLE 4.6 

EVALUATION QUESTIONNAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 



Sltai LOUISIAMA 





19 


r7-7i 


197ft-79 


















Nwter of 


X of 


Ni^r of 


X of 


Mn^r of 


X of 


MiMter of 


X of 


rrolMC Diractor 


1 




HM 




1 


100 


N/A 






2 


lOO 


2 


100 


2 


100 


2 


100 




12 


100 


17 


81 


12 


100 


25 


100 




5 


100 


2 


100 


4 




2 


100 


CiMalflutloa of 


12 

3 


100 

to 


1» 

0 


90 
0 


11 
1 


92 


22 
0 


6« 

0 


Ubrarl.. 


2 


loo 


2 


100 


2 


100 


1 


SO 


StudMt - Gr«d« 3 


0 


0 


100 


»7 


44 


94 


110 


99 


Stii4«DC - CraU- 4-4 


ISB 


97 


253 


73 


154 


96 


211 


60 




205 




m 




201 




363 




Stii«J«ttC lafonMtlM 


301 


100 


67^ 


93 


266 


87 


657 1 


92 



H/A - Mot ApyllcB^l* 



BEST 



5B 
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Special Features 

A close working relationship between reading specialists and 
classroom teachers characterized this project. With the specialist 
serving as role model, collaborator, consultant, and de facto supervisor, 
classroom teachers reported the project offered them .an opportunity to 
grow, adopt new practices, and gradually assume a stronger role in 
reading instruction. 

Another noteworthy feature of the Louisiana project was the 
effort to customize the basal reading series to serve the needs of 
local students. 

Special Circumstances 

The presence of the Precision Teaching System in both the treat- 
ment and comparison schools makes it difficult to isolate Special- Emphasis 
and its impact on student reading achievement. IMlike the first year 
of operation, during the second and third years of program operation 
Special Emphasis reading specialists no longer replicated Title I 
operations. However, distinctions between Title I and Special Emphasis 
programs remained unclear. 

Student retention (repeating the grade) was far more prevalent 
at this site than at the other study sites. Approximately 25% of the 
sixth grade students were retained following the 1977-78 school year. 
There was no limit to the number of years a student could remain at 
a particular grade level, and there was evidence of students repeating 
the same grade more than once. While many, of these students might 
benefit from the services of a special education or learning disabilities 
program, parents were generally reluctant to identify, test, and place 
children in such settings. 



tion to meet developmental skill needs, and a close linkage between 
Special Emphasis and classroom reading instruction • Because of the 



Summary 



The' key features of the Louisiana Special Emphasis Program rev 
the diagnostic-prescriptive approach, the use of small group in- rue- 
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limited experience and deprived backgrounds of many students in this 
school district, school officials and staff have supported programs 
and strategies designed to overcome these social handicaps. The exist- 
ence of the Title I Precision Teaching System, however, represented a 
confounding influence on any assessment of impact. All other indica- 
tions were present for a genuine Special Emphasis educational interven- 
tion—from diagnostic programming to close faculty-specialist cooperation. 
At the same time, the presence of Precision Teaching may have had a 
benign effect on the study in that the visible amenities of additional 
instructional staff and equipment in the comparison school may have 
reduced the experimental contamination (the John Henry effect"^). With 
Precision Teaching acting as a "placebo,'' comparison school teachers 
may not have been stirred to respond with a "we can work harder than 
you" campaign. 

The Louisiana site was in compliance with the Special Emphasis 
guidelines, with two exceptions: the size of the treatment and compari- 
son populations and the lack of a reading motivation component in 
Special Emphasis. 

In terms of the site's original objectives, scores did improve 
on the district's standardized testing program but not as much as was 
hoped. In 1979, 30% were at grade level, up from 14% in 1976. While the 
50% objective was not reached, school officials were pleased at the 
progress. 

The second goal of the project was to determine factors contrib- 
uting to reading problems. Over the course of the Special Emphasis 
project, reading specialists noted those skill areas particularly 
problematic for students in the treatment schools. They documented 



G. Saretsky, "The OPO p.c. Experiment and the John Henry Effect," Phi 
Kappan , 1972, 53,579-581. 
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successful and unsuccessful instructional techniques and materials to 
serve as future resource guides for teachers working with low-achieving 
students. 

From the perspective of local officials and staff, the Louisiana 
project was considered a success. 
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MICHIGAN 



Background 

The Michigan site is located in an indepsndent city within the 
boundaries of a large metropolitan area. The city faces problems con- 
fronting most urban areas today: escalating costs, a shrinking tax base, 
and population flight. The corresponding impact on the city's schools 
includes frequent turnover of top administrators, budget cutbacks, teacher 
cutbacks, and transient student population. The school district, which 
serves the city, has sought assistance in a wide variety of Federal pro- 
grams to address the mounting social, educational, and economic problems. 

Project Schools 

The treatment and comparison schools in this site were well matched 
in terms of demographic characteristics of students, facilities, instruc- 
tional approaches, and materials. Until the fall of 1978, both schools 
served students, grades kindergarten (K) through 6. At that time, sixth 
graders were transferred to another building, leaving a K through 5 pop- 
ulation at each school. Enrollment characteristics of the two schools 
are displayed on Table 4.7. The table reveals highly comparable popu- 
lations. Participation in subsidized lunch programs was very high at 
both schools. While students dropped out of the study due to family 
mobility, those that entered the study population reflected the same 
characteristics as those departing. 

The shift in enrollment caused a decrease in teaching person^ 
well. Average class size increased from 27 students to 32 and 34, osp - 
tively, at the treatment and comparison ^chools. Staff changes haa tiu 
effect of closing the gap in education and experience between the two 
groups of teachers. Staff characteristics are summarized on Table 4.8. 

In addition to classroom teachers, both schools at this Special 
Emphasis site had numerous specialists providing services for the school 
population. These were a librarian, a speech specialist, a learning 
disabilities specialist, nurse, reading specialist, physical education 
and music/ arts teachers, a counselor, ^ il worker, and a psychol 
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TABLE 4.7 
ENROLLMENT CHARACTERISTICS 



sice; MICHIGAN 



! School: 

1 


Special Emphasis 


Comparison 


1 

rrojecc Tear: 


19 77-73 




1977- 78 


1978-79 


Kmafaer of Students 


670 


602 


588 


515 


By Sex: 










Male 


52% 


51Z 


49% 


49% 


Female 




49% 


51% 


51% 


3v Racial/ Ethnic farp^rt-^^ • 










Black 
White 


' 1% 


96T 
IZ 


99% 
* 


99% 
* 


M ill 4 fc ^ w 










Other or uncategorized 




3Z 


1% 


1% 


Students Receiving Free or 
Reduced-P^rice Lunch 


79Z 


81% 


81% 


81% 


Students for Whom English 
is a Second Language 

: 




1% 


4% 


3% 


Students Absent More 
Than 252 




6% j 


5% 


7n 



Rounding estimates are responsible for column totals below or above 100%. 



Less Chan .5% 



TABLE 4.8 
STAFF CHARACTERISTICS 

Site; MICHICAK 



School: 


Spec ■ 't 


Comparison 


Project Tear: 


1977-78 


19 ^79 


1977-78 


1978-79 


number of Teachers 


25 


19 


22 


15 


Teachers with Graduate Degrees 


48% 


65% 


71% 


67% 


Average Teacher Experience 


7 yrs. 


11 yrs. 


13 yrs. 


15 yrs. 


Average Number of Students/Class 


?7 


-0 


27 


« ! 
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State and Federally sponsored programs abounded. Both schools 
were eligible for and received Title I services. Each had a full- 
time Title I reading specialist and a reading consultant funded by the 
state and district. Three district reading aides were assigned to the 
treatment school. They worked in conjunction with several teaqhers pro- 
viding tutorial instruction and assisting with small groups and materi-^3 
preparation. At the comparison school, the district had assigned four 
reading aides. These aides worked exclusively with the DISTAR program. 

Both schools are housed in similar buildings erected in the 1920 's. 
They appeared generally well maintained and each was brightened by color- 
ful bulletin boards and public area displays. Neither school was air 
conditioned and some upper grade classrooms in the comparison school 
lacked ventilation. Equipment and materials were not lacking at either 
school. Software resources for reading instruction (e.g., kits, tapes, 
games, basals"^ were abundant. 

Aside from Special Emphasis, the two schools were programmatically 
almost identical. The regular classroom reading program followed a 
traditional basal reader series and a district-developed skill mastery 
management (looping) system. DISTAR, a decoding program to enhance 
phonics and word recognition skills, was used in grades K and 1 at the 
treatment school, and grades K through 2 at the comparison school. 

The school district required a minimum of 30 minutes of reading 
instruction daily. At the treatment school, first and second graders 
had 70 minutes of inutr ' ti'^n, all under the supervision of Special 
Emphasis personnel. T.i ir; through fifth/sixth graders spent 30 minutes 
per day in classroom reading instruction with selected students receiv- 
ing an additional 30 minutes from Special Emphasis personnel. At the 
comparison school, all students had 80 minutes of language arts instruc- 
tion, which included reading as well as spelling, grammar, and writing. 
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A comparison of teaching practices at the Special Emphasis and 
comparison schools (Table 4.9) reveals an exceptionally close match. 
Teachers in both schools tended to be diagnostic-prescriptive in their 
approach. A slight majority in both schools preferred a structured 
learning environment with the remaxuiag ..chers mixing structure with 
some flexibility. In the Special Emphasis school, of those teachers 
responding in 19 78 and 1979, staff turnover and/or shifts in orientation 
reflect a ve from diagnostic-prescriptive to eclectic and whole class 
and from eitaer structured or flexible to eclectic. In the comparison 
school, owing to either of the same factors, fewer teachers were diag- 
Tiostic-prescriptive in 1979. 



TABLE 4.9 

CLASSIFICATION OF TEACHING PRACTICES 



sits : MICHIGAN 



Taachlng 
Orlsncatlon 


1977-78 


1978-79 


Spsclal 
Eaphasls 


ConpATlBon 


Hmhaals 


ComDarlion 


Dlasnostlc Approach 


M Z* 


N 




N 




N 




DlagnoftClc- 
PrMcrlptlvtt 

Edsctlc ^ 


18 


82 


18 


so 


10 


67 


10 


67 


4 


18 


2 


10 


4 


27 


5 


33 


VhoXtt ClMMm 


0 


0 


0 


0 


1 


7 


0 


0 


MttDAseatnt Strrlm 


















Scructtirsd 


U 


50 


10 


50 


9 


60 


10 


66 


Eclsctlc 


8 


36 


7 


35 


6 


40 


2 


i:; 




3 


14 


3 


15 


0 


0 


3 


21 



BMttd oa Cfa* niaib«r of claMroov tuchars raapondlng. 

Tha daiagnatlon "Eclectic" indicataa a teaching orientation which cooblnea elements 
fron both approachaa or styles. 



The Special Emphasis Program 

The particular objectives articulated by the staff for the project 

were: 

• Project participants will achieve 1 month's growth for each 
month in the progrcun. 

6^ 
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• Students will demonstrate a more positive attitude toward 
reading. 

• Parents and community members will demonstrate awareness 
and positive support of the program* 

• Teachers will improve their skills in the teaching of read- 
ing. 

The program designee to acbtr^-- these objectives utilized the school 
district's regular reading program (basal plus a skill mastery system^ 
and introduced the reading specialist/ teacher and aide to assist in and 
enhance its delivery. 

Project Staff 

The Special Emphasis Project was headed by a school district cen- 
tral officer administrator. The original project director left after 
the 1977-78 school year and another school administrator inherited 
Special Emphasis. Due to the multiple other responsibilities which these 
directors had, neither assumed strong leadership roles in the educa- 
tional or administrative aspects of the project. Instead, the head 
reading specialist provided overall direction and leadership; however, 
her lack of position in the administrative structure limited her ability 
to provide strong direction to the program. The project school princi- 
pal played a support role but was not actively involved in the program. 

A private school was a nominal participant in the project from 
fall 1976 to spring 1978, but was not included in the evaluation. Dur- 
ing this period, one project reading specialist and one aide were 
assigned to the private school on a half-time basis. 

Five reading specialists and six aides were employed by the Special 
Emphasis Project. All five specialists had graduate degrees; their years 
of Lc/^chiag experience ranged from 3 to 16. The five reading speciali;?ts 
warn each assigned specific grade levels. Two worked with first and 
second grades and one served eac- oi the remaining third, fourth, and 
fifth grades. Reading specialists trained and supervised the aides who 
provided individual attention to designated students and prepared mate- 
rials. 
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The Special Emphasis Treatment 

In the first and second grades, reading specialsts worked in the 
regular classroom with the classroom teacher present. During the 70- 
minute reading period, student groups rotated between the specialist, 
classroom teacher, and aide. In general, the classroom teacher con- 
ducted the basal reader program, while the specialist provided enrichment 
and skill reinforcement activities. As might have been expected, plan- 
ning sessions and conferences regarding student progress occurred fre- 
quently at these grade levels. First and second grade teachers planned 
weekly with project staff. 

In the third through fifth grades, students receiving Special 
Emphasis instruction met with a reading specialist outside their regular 
classroom for small group instruction. The frequency of their attendance 
depended upon the degree of their reading' deficiency. Third through 
fifth/sixth grade teacher? and reading specialists typically conferred 
toward the end of each grading period. 

In addition tc isolated enrichment skill development and reinforce- 
ment activities, reading specialists introduced and used a content- 
oriented approach to reading. This approach called for the teaching of 
reading in the context of specific subject areas, such as social studies 
or science. While this approach was used at all grade levels, it was 
most prevalent at the fi.fth grade level. 

The communication between the regular classroom teachers and Spe- 
cial Emphasis staff appears to have improved over the operation of the 
program. The relationship between each classroom teacher and the read- 
ing specialist assigned to his or her class was individualized. That 
is, the reading specialist and the specific classroom teacher mutually 
agreed to procedures for implementing Special Emphasis instruction — 
rather than following a prescribed schoolwide system. 
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Use of Materials 

The instructional program at this site was based upon the use of 
the basal reading series (K-3, Bank Street Readers; 4-5, Holt, Rinehart, 
Winston, and Houghton Mifflin; 6, Holt, Rinehart, Winston). A locally 
devised manageiaent system was developed for use in conjunction with 
the Bank S'creet Readers. Guided by publisher information, project 
personnel identified the sequential skills covered by the basal series. 
Next, the/ selected workbook pages to be completed by students and 
graded by staff. A score of 80% or above indicated student mastery 
of a particular skill. Stiidents who failed to meet this criterion 
were guided through an alternative series of activities and retested. 
Records of each student's progress were maintained by the classroom 
teachers and specialists. DISTAR materials were also a component of 
this program for first grade. Students in grades 3-5/6 used commer- 
cially available reading collections as part of their reading program. 
Aside from the management system used by the project school, materials 
used on conducting the reading program were the same at both schools. 



Inservice Training Program 

Inservice training opportunities in the form of workshops were 
available to teachers at the treatment school. These were provided by 
the project director, reading specialists, and, in 1976-77, by an out- 
side consultant who conducted several sessions ror which college credit 
was given. Participation was voluntary. Fewer than half of the class- 
room teachers attended these workshops and reported they were "somewhat" 
helpful in enabling them to carry out their classroom reading activities. 
Quest ionn.»Ires were administered to the staff inviting their input re- 
garding content for the workshop sessions. Topics covered included 
interpersonal relations. Implementation of a diagnostic-prescriptive 
approach to teaching reading, terching reading in the content areas, 
diagnosis of reading problems, and motivational activities. 
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Sunrmer Program 



In 1978, the Michigan project ran a 17-day summer program. The 
program ran from 9 AM to 12 PM and consisted of 160 minutes rf reading 
instruction or reading-related activities followed by a 20-minute super- 
vised lunch. Enrollment was 148, with attendance averaging 120 daily. 

The program's objectives were: 

• To retain skills through review and reinforcement activities. 

• To diagnose student needs and individualize instruccxon. 

• To focus on comprehension skills. 

Four reading specialists, five teachers (including a librarian and gym 
teacher), and nine paraprofessionals were employed. Each specialist and 
teacher handled four groups of 10-20 students for 40-minute periods. No 
volunteers participated in the program. 

Teacher-made and commercially- developed materials were used along 
with paperbacks and films trips. Students also made books for use during 
the Slimmer. Basal readers were not ':sed. 

The summer program was informal, and its thread of continuity with 
the ree-^ular school year program was the stress on comprehension skills. 
The project director basically served as a facilitator, assisting in the 
planning of special events, and as manager/ administrator, assuring the 
timely processing of staff payroll and the availability of supplies. 

A unique feature of this program was the way in which library and 
gym periods were directly related to reading instruction. Students par- 
ticipated, on a rotating basis, in 40-rainute library or gym periods 4 
days of the week. In addition, they could earn an extra gyiu period 
based on their performance during the week. The extra gym period was 
used as a motivational device. 

In 1979, Michigan ran a 20-day summer program. Students attended 
school from 9 AM to 12 PM, with instructional periods from 9 to 11:30 
.\M. A 30-minute lunch, supervised by teachers in the classrooms, foiiowei:. 
Enrollment was 126. 
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Program objectives for 1979 were: 

• To review and reinforce student skills. 

• To extend and enrich skills of students at grade level. 

• To provide opportunity for recreational reading. 

The staff for this program was reduced and, unlike the program of the 
previous year, was strictly academic. TWo reading specialists, five 
regular classroom teachers, and seven aides comprised the staff. The 
district-level decision to conduct a sxnmner program was made after 
students had been dismissed on the last day of the regular school year. 
The appointed staff was contacted over the weekend and requested to 
report on the following Monday. No program had been planned; no special 
activities were provided. Several days into the program, the onsite 
program supervisor was informed that he had a budget of approximately. 
$50 for materials. An alternative workbook series served as the curric- 
ulum guide and source of instruction and activitiee. A limited selection 
of books from the school library was placed in each classroom. Table 
4.10 provides a summary of program statistics for 1978 and 1979. 

Compliance with Special Emphasis Guidelines 

The following discussion focuses on the adherence of the Michigan 
project to the USOE gxiidelines for Special Emphasis. 

This site assigned a full complement of reading specialists to 
serve students. at the project school. All first and second graders 
were covered as stipulated in the guidelines. Michigan, however, did 
not provide for instruction of all third througji sixth graders having 
reading problems. Lack of compliance was acknowledged and brought to 
the attention of USOE by site personnel. According to data supplied 
by the site, third through fifth grade students received 30 minutes 
of daily reading instruction. This was below the minimum time required 
by project guidelines (40 minutes). 

The evaluation team considered the summer progiam for project 
year 1977-78 an outstanding effort. Largely due to the efforts of the 
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TABLE 4.10 
SUMMER PROGRAM SUMMARY 



Sit« : MICHIGAN 



Summar 1978 Suanr 1979 

Protm Duration 

^••ka 3.5 

Hours par day 3.O 3.0 

Inatruc tl o n al hours in raadlng 2.75 2.5 
and raadi&s-Talatad aetlvltlas 
(hours par day) 

Total School Earollaaxit 670 502 

SuMtr School EaroUaant 1A8 126 

Pareant of Total EnroUaant 22 21 

Taachar/Adult-Studant Baclo 1:8 1.-9 
Staff 

Baadlag Spaciallsts A 2 

Taachara 3 5 

Mdas 9 7 

Librarians 1 0 

Gyv/Art Taachar 1 0 
* 

Voluataara 0 0 



\oluataan not inclodad in cos^uciag Taachar/Adult- Studant Ratio. 
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head reading specialist, trips, lunch, library activities, and physical 
education were integrated into the instructional program. The 1978-79 
sumner program was strictly reading instruction. No planning preceded 
the effort and direction regarding program goals and an operating budget 
was never specified. The individual assigned to administer the program 
was unfamiliar with Special Emphasis. 

The inservice program in Michigan was unclear from the evaluation 
data. Some training sessions were held. However, they were poorly 
attended and poorly received by the teachers . Participation in program 
planning did not extend beyond the district principal reading specialist 
levels . No attempt to draw additional groups into the planning process 
was noted. From teacher comments, it appears that the greatest handicap 
of this particular project was the lack of dialogue and consensus on 
program objectives. Teachers, reading specialists, and the project 
director inheriting this project agreed that goals and objectives for 
this program had never been clearly formulated and articulated. 

A skill mastery record keeping system existed in Michigan, 
independent of Special Emphasis. An outstanding feature of this project 
was the well matched treatment and comparison groups. Other project 
guidelines, including diagnostic testing, achievement testing, and 
the availability of test results to parents or guardians were met. 
Activities to stimulate interest in reading which included the partici- 
pation of teachers, administrators, parents, and students were not 
observed or reported by site personnel. 

The evaluation study team encountered resistance to the prescribed 
procedures for cest administration at this site. Tnis problem is 
documented in Appendix G. Project personnel cooperated fully with 
efforts to correct coding problems. Table 4.11 reports the response 
rates for the various data collection instruments. 
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TABLE 4.11 



EVALUATION QUESTIONNAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 



Slt»i HtCHlrAW 





1977-78 


1978-79 




Special Emphmi^ln 


CoMparlnmi 


!^peciitl Kmphantn 


Coapurlnon 




HuMjar of 
Raapondanta 


Z of 
Popuiatton 


Himh^r of 
Respondents 


Z of 
Population 


HiwJfcr of 
ReBPOndenta 


Z of 
Population 

0 


KitaArr of 
Regpowdente_ 

N/A 


X of 
PopMlatltfn 


rcojcct :?lrecCtir 


I 


100 






0 


Principal 


1 


100 


1 


100 


I 


100 


1 


100 


Tcsclwr 


23 


100 


21 


95 


17 


09 


15 


ioo 


toadlnx Spvelalist 


A 


100 


1 ' 


100 


4 


67 


1 


100 


Clnnntf Icatlon of 
T«Mchtnit rmctlMfit 




















22 


Bn 


20 


91 


15 


79 


15 


tn\/ 


IUi«<ltnB Sp«€ialiata 


1 


17 


1 


100 


5 


83 


1 


100 


Librarian 


1 


100 


0 


0 


i 


100 


I 


100 


StudMt - Grada 3 


99 


•9 


95 


93 


131 


100 


100 


77 


St«ii4«nt ' GrarfM 4-6 


264 




239 


88 


205 


91 


170 


76 


r«r«iiC 


335 




4t2 








289 




stufivnc Inforauitlon 
ClMckUat 


637 


9n 


5«3 


99 


602 


100 


315 


100 ' 



N/A • Not Apptlciihl* 



In summary, Michigan experienced difficulty in implementing a 
project which met established guidelines. This site was out of com- 
pliance in the following areas: 

• Treatment of all third through fifth/ sixth graders having 
reading problems. 

• Minimum of a 40-minute reading instruction period for third 
through fifth/sixth grade students. 

• Broad-based participation in program planning. 

• Broad-based participation in activities developed to stimu- 
late interest in reading. 
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Special Features 

The role of reading specialists at this site was to implement the 
regular school developmental reading program. Thus, opportunities to 
employ their expertise and creativity were limited somewhat by the pre- 
scribed basal program. The wide variety of reading specialist-classroom 
teacher teaming modalities was a unique feature of this .'rite. 

Special Circumstances 

According to the project director, the project was not able to 
serve all children, grades 3 through 6, who were reading one or more 
years below grade level because of staff time constraints. While this 
situation rendered this project out of compliance with USOE guidelines, 
the USOE and project personnel agreed upon a level of participation to 
include only students in the lowest 20% of each grade 3-6 to receive 
Special Emphasis instruction. Table 4,12 summarizes participation and, 
enrollment data for 1977-78 and 1978-79. 



TABLE 4.12 
TREATMENT GROUP SIZE BY GRADE LEVEL* 



StC« : HICHIGAN 





Project Tamr 


1977-78 


Prolact Yaar 197R-79 




TOtAl 

Enrollnaac 


X Servad By 
SpaclaX Eophaaia 


total 
Enrollment 


X Sarvad By 
Spadal EoDhaais 


Gradtt 1 


131 


100 ■ 


120 


100 


Grada 2 


125 


100 


117 


100 


Grad« 3 


111 


26 


130 


23 


Grada 4 


104 


33 


112 


27 


Grada 5 


93 


17 


113 


27 


Grada 6 


106 


23 







Biw.d on Expcrlotncal School Principal Queatiormslre. 
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Parent Involvement was nonexistent In either planning or operating 
the program. An laformal awareness effort was undertaken by distribut- 
ing Informational literature at the school open house. The Special 
Emphasis staff attempted to involve parents by preparing materials to 
assist them in working with their children at home, 
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The relationship between the project school and comparison school 
was poor due to the lack of communication regarding rationale, duration, 
and procedures for the comparison school's participation in the study. 
In addition, some teachers in the comparison school felt that testing 
procedures and the testing schedule imposed by the Special Emphasis 
staff were disadvantageous to their students • Teachers at the compari- 
son school also expressed resentment over the extra work when they and 
their students received no benefits. 

Summary 

The strengths of the Michigan project were the comparability 
between the treatment and comparison schools, the experienced staffs, 
the generally flexible working relationship between the reading 
specialists and the classroom teachers, and the 1977-78 summer program. 
Obvious limitations on the exper:lmental design were the project's lack 
of consensus objectives, the problems in following prescribed testing 
procedures, and the project's inability to serve the entire target group 
of readers in grades 3 through 6. The diversion of project resources tc 
the participating private school may have compromised project effective- 
ness. 

There was no evidence that the original objectives set for the 
project had been met. The project director indicated that students in 
the project school had improved on the district's standardized tests, 
though he made no claim that they had gained 1 month's growth for each 
month in the project. 
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OHIO 



Background 

Both the experimental and comparison schools at the Ohio site 
lie less than 1 mile apart in a downtown fringe area of a large 
industrial city. TWo major problems confronted the public schools of 
this city during the Special Emphasis Project. First, the Ohio ban on 
deficit spending caiised severe budgetary constraints. Second, a court 
order to desegregate schools forced major staff and student shifts 
among schools. 

The staff at the Ohio site had initially embraced the opportunity 
Special Emphasis afforded to pilot a new approach to their reading 
curriculum. The project received strong central office support and per- 
severed despite overwhelming local problems. Although the project con- 
tinued to operate during the 1978-79 school year, GRC, with the concur- 
rence of USOE, decided to drop the site from the evaluation because of 
insurmountable problems, namely, the closing of the comparison school 
and a lengthy teacher strike. Therefore, the description of this 
Special Emphasis Program and discussion of its impact covers the period 
of operation from spring 1977 to fall 1978. 

Project Schools 

The treatment and conparison schools at this site were fairly 
well matched in terms of size and the socioeconomic and demographic 
characteristics of students. There were 301 students in the treatment 
school and 233 students in the comparison school (grades 1 through 6) . 
The population of the area in which the schools are located is urban, 
predominantly white, and transient. Children transferred frequently 
between the two schools. Between 66% and 72% of the two schools' 
families received public assistance funds. Interestingly, neither 
school received Title I lunds. Table 4.13 summarizes student enrollment 
data* 
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TABLE 4.13 
ENROLLMENT CHARACTERISTICS 

Site: OHIO 



School: 


Spadal Eophaala 


Conparlson 


?rojttct Y«ar: 


1977-78 


1978-79 


1977-78 


1978-7? 


Nuab«c of StucUnts 


301 


N/A 


233 


N/A 


By S«x: 
HaX« 


49Z 
51Z 


- 


48Z 
52Z 


- 


By &aclAX/Ethnic CatftgoriM: 
BUck 
Whlt« 
Hispanic 

Othar or imcatagorlxad 


IX 
89Z 
8Z 
2Z 


- 


88Z 
7Z 
5Z 


- 


Studanta Bacalvlixg Fraa or 
Eaducad-Prlca Lunch 


66Z 




72% 




Studanta for Whoa Engli4ih 
la a Sacond Languaga 


9Z 




lOZ 




Studanta Abaant itora 

"OiMa 25% 


5Z 




ilZ 





Rounding estlaatas are rasponslble for column totals below or above lOOZ. 



New principals were assigned to the treatment and comparison 
schools in the fall of 1977; both had a positive orientation toward 
Special Emphasis. The coii?>arison school staff had fewer classroom 
teachers due to its lower enrollment. However, average class size was 
nearly identical (30 at the treatment, 29 at the comparison). A higher 
proportion of comparison school teachers had master's degrees. Likewise, 
the level of experience was higher for the comparison school teachers. 
Table 4.14 provides a comparison of staff characteristics at each school. 
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TABLE 4.14 
STAFF CHARACTERISTICS 

Sits: OHIO 



School: 


Special Emphasis 


1 

Comparison 




1977-78 


1978-79 


1977-78 


1978-79 


Nusd>ftr of TMChars 


10 




3 




TMCh«rs vlth Graduats D«gr««8 


112 




292 




Averagft TMchcr Exp«rlcnc« 


14 yrs, 




20 yra. 




▲v«r&f d Hiaibar of Scud«at8/ClAs« 


30 




29 





Facilities and services in the two schools were disparate. The 
project school occupied a modern building with ample library space, 
a new gymnasium, a cafeteria, and playground. Supplementary services 
were provided by a school nurse, a speech and hearing specialist, 
and a school district psychologist. Additional tutoring in reading 
was available from a learning disabilities specialist, and the school 
librarian provided supplementary exirichment activities. In contrast, 
the comparison school was in an old but well maintained building. 
There was no learning disabilities specialist, psychologist, or school 
nurse. The librarian's role was limited to providing reading materials 
and guidance to classroom teachers. 

The treatment and comparison schools were adequately supplied 
with books, instructional materials, and audiovisual equipment. However, 
it appears that the quantity and quality of these resources were greater 
at the treatment school. 
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Except for Special Emphasis, the reading programs at the treatment 
and comparison schools were similar. The regular classroom reading 
program in both schools was based upon the school's basal reading series 
(Houghton Mifflin for grades 1 through 3, and Harcourt Brace for grades 
4 through 6). A district-wide management system was employed in each 
school to monitor student progress. The system was locally developed 
and spanned grades 1 through 6. 

A survey of teaching styles in the respective schools, based on 
the Classification of Teaching Practices instrument (Table 4.15), 
revealed a close similarity between the two. If any differences existed, 
the comparison school teachers as a group were slightly more diagnostic- 
prescriptive and slightly more flexible than the Special Emphasis school 
teachers. According to responses on the teacher questionnaire, no 
comparison school teachers utilized large group instruction as a major 
strategy, whereas 40% of the teachers in the Special Emphasis did. 



TABLE 4 .15 
CLASSIFICATION OF TEACHING PRACTICES 



Sita : OHIO 



OrlftnCAtloQ 


1977-78 


197fi 


1-79 


Spaclal 
Eaohula 


Conparison 


Spadal 
EoiPhAJls 


Cogrparlaon 


DlAffooatlc Approach 

DlAgnoatlc- 

Pr«»crlpr.lv« 

. . , t. 
HlioXa CImmb 


N Z* 

6 60 
4 40 
0 0 


N 2* 

5 71 
2 29 
0 0 


N 

DAZA 
AVAIL 


N 

iWT 
JLE 


KaiunnBTit Style 
Stxuctttrsd 

Edftcdc ^ 

FlezibU 


8 80 
2 20 
0 0 


5 71 
2 29 
0 0 


DATA 
AVAIL/ 


«)T 
BLE 



Baaod on thm auabar of cluirooa teachers responding. 



The designation ''Eclectic'* indicates a teaching orientation which 
coablnea elements from both approaches or styles. 
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The staff of the comparison school in Ohio expressed dissatisfac- 
tion with its involvement in the Special Emphasis Project. Staff members 
complained that little effort was made to explain the project and their 
role in it or to provide sufficient advance notice of testing dates. 

The Special Emphasis Program 

The objectives for the Ohio Special Emphasis Project were: 

• Reading specialists/teachers will provide reading instruc- 
tion for all children in grades 1 through 1 and for children 
with reading problems in grades 3 through 6. 

• Pre- and inservice training will be provided throughout 
the project period for professionals and other assigned 
adults in project schools. 

• Project staff will implement a 4-week summer program for 
children enrolled in project schools. 

Data in Table 4.16 indicate that this project was not serving all first 
and second grade students as required by Special Emphasis guidelines. 



TABLE 4.16 
TREATMENT GROUP SIZE BY GRADE LEVEL* 



Slta: OHIO 







Prolact Tear 1977-78 


Project Year 1978-79 






local 
Eorollnanc 


X Sarvad By 
Special EazDhaA-tA 


Total X Served By 
Enrollment SneclAl RmpK«.^« 


Gradft 


I 


59 


47 






2 


53 


58 


DATA NOT 


Cradft 


3 


44 


73 


AVAILABLE 


Grade 


4 


50 


50 




Grada 


5 


46 


39 




Grada 

* 


6 


4S 


67 





Baaed on Experimental School Principal Questionnaire. 
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At the outset, it should be noted that events and conditions at 
this site crippled the Special Emphasis Project. District-wide budgetary 
problems, staff reassignments , and ambiguities in status had demoralized 
the entire staffs at bcth schools. Reassignment of substantial numbers 
of students at the project school and the closing of the comparison school 
precluded evaluation efforts after fall 1978. Within the program, the 
greatest handicaps were lack of staff continuity (both reading teachers 
received termination notices in spring 1978 and two teachers having 
seniority replaced them) and erratic instructional periods due to 
teacher strikes. When schools finally reopened in fall 1978, Special 
Emphasis instruction continued. However, the student and staff popula- 
tions at the project school were considerably altered, and the evalua-- 
tion was discontinued. 

A nonpublic school wao a nominal participant in Special Emphasis 
at this site. One reading specialist and an aide provided services to 
this school. No data were collected from the specialist, and the SDRT 
was never administered to these Special Emphasis students. 

The overall instructional design of the Ohio project focused on 
a language experience approach to reading. Special Emphasis attempted 
to address the student's minimal language facility and, in so doing, 
complement the existing classroom developmental program in reading. 
The program stressed four principles: 

• Expanding complexity, flexibility, and precision of 
language and thought 

• Modeling new language patterns 

• Eliciting children's use of new language 

• Providing specific praise for use of precise language 

Project Staff 

A full-time project director with no other regularly assigned 
responsibilities served this project. The director's primary function 
was to set guidelines for the conduct of the program. In addition. 
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she ... -i and ordered necessary materials and supplies. A full-time 

project becrtu.. ass:' ted the director with administrative and record 
keeping tasks. 



Two reading teachers provided reading instruction at the treatment 
school. Neither had a graduate degree nor experience as a reading teacher 
prior to Special Emphasis. Their responsibilities included: screening, 
testing, diagnosing reading problems, and assigning children to groups 
on the basis of their reading skills. One of these teachers assisted 
in the planning and delivery of the inservice training program. While 
reading teachers reported that they met weekly with classroom teachers 
to pUn instructional activities, this was not corroborated by classroom 
teachers. According to the latter, they typically conferred with the 
reading teachers once or twice a mjnth. 



Three aides participated in the program. They were involved in 
record keeping, materials development, and remedial reinforcement 
activities. They were hired by the project director and trained by 
the reading teachers. 



The Special Emphasis Treatment 

Each reading teacher was located in a classroom imaginatively 
organized into various learning centers and an area suitable for group 
instruction. Upon arrival, students participated in a 20-minute group 
instruction period. They were then assigned to particular learning 
stations for independent or small group reinforcement activities. 

First and second graders came to the reading teachers' classrooms 
for instruction each morning and spent about 40 minutes with the reading 
teacher daily. In the afternoon, third through sixth graders in groups 
numbering 10-12 reported to the reading teachers' classroom. These 
students wero. selected from their regular classrooms on the basis of 
their skill deficiencies. Each student participating in Special 
Emphasis returned to his or her classroom with a daily follow-up activity. 
This was a unique effort to inform classroom teachers and integrate 
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them into the Special Emphasis Program. In general, the classroom 
teacher was the students' primary reading instructor, with thi reading 
teacher acting in a reinforcement and supplemental role. 

Use of Materials 

Instructional aids utilized in the Ohio program included the 
overhead projector, a tachistoscope, tape recorders, and controlled 
reader. Listening stations, record players, and a movie projector 
were also used. Games, kits, trade books, and teacher developed learn- 
ing aids were integrated into the instructional -rogram. Students 
appeared to find Special Emphasis classes appealing. 

Inservice Training Program 

Teachers at the project schools (public and private) were offered 
inservice training opportunities. According to questionnaire responi;es 
they spent up to 4 hours per month in training. Inj^ervice activities 
were planned and presented by the project director and one of the 
Special Emphasis reading teachers. The sessions were characterized 
as having marginal value by about half of the staff who attended and 
responded. 

Summer Program 

The 1978 Special Emphasis summer program in Ohio ran for 4 weeks, 
offering diversified reading activities over a 3-hour period. Basic 
objectives were: 

• To reinforce and continue instruction in the skill areas 
covered during the regular school year. 

• To offer enrichment for those students noM participating 
in Special Emphasis during the regular school year. 

Approximately 70 students were served including those in the public 
treatment school and the participating private school. 
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Two reading specialists and four aides were employed by this 
program. The students were divided into two groups, one composed of 
first and second graders, the other of third through sixth graders. 
Each reading specialist handled both groups at different 1 1/2 hour 
periods in the day. Reading specialists spent 15 minutes of each day 
giving reading instructions to the four aides, who also received 
additional training in weekly staff meetings. 

The design for the summer program was determined and structured by 
the staff. While commercially prepared kits were used to some extent in 
the teaching of reading, teachers relied more heavily on materials which 
they developed themselves. Predeveloped materials used by teachers 
consisted of individualized reading kits and creative writing kits. 

Prior to the end of the regular school year, children were tested 
for skill mastery and informal classroom teacher assessments were solicited. 
The summer program then followed up on needs of individual students identi- 
fied by these assessments. Informal diagnostic probes were made at the 
end of the summer to chart student progress. 

The project director's role was primarily one of coordination and 
administration. The direcr . r also served as a substitute teacher when 
necessary. 

Noteworthy features of the summer program were the focus on creative 
expression well as the emphasis on skill application. Summer program 
statistics for 1978 are presented on Table 4.17. 



Compliance with Special Emphasis Guidelines 

Data from the Ohio site were reviewed to assess adherence to the 
implementation guidelines during the 1977-78 project year— the last 
year Ohio vas included in the evaluation. 

81 
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Sit*: OHIO 



Prograa Dur«tlon 
VMks 

Hours p«x d«y 



TABLE 4.17 
SUMMER PROGRAM SUMMARY 

y 1978 



iMtructlonal hours in rMding 
«ad rMdiA$-rttlAtftd actlvitlM 
(hours psr dsy) 



4.0 
3.0 



Sunnsr 1979 

DATA NOT 
AVAILABLE 



Tocal School EorollatAt 



School EnroUasnt 



301 
70 



Psrcsnt of Total EnroUssnt 



Tsaefaor/Adulc-Studsnt Ratio 



23 

1:12 



Sca£f 

Bssdlng Spodalista 

Tsachsrs 

Aldss 

Llbrsrlsas 
Gym/Axt Tsachsr 
Volua tsars 



This psrcantsgs Is allgihtly Inflated by tha participation of some students 
from the private achool Special Emphasis Program. 



82 
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This project had two reading teachers working in the treatment 
school during the 1977-78 project year. All first and second graders 
were purported to be served, however, data previously presented do not 
support this claim. It is not known whether respondent error accounts 
for the less than 100% participation at the first and second grade 
levels. The minimum instructional period of 40 minutes was met. A 
creative summer learning program was cperating during the 1977-78 
project year. Inservlce training consisted of informal sessions pro- 
vided by the project director and one of the reading teachers. Program 
planning and/or participation in the Ohio project did not extend 
beyond the school district and school staff levels. Broad-based par- 
ticipation was to be a major thrust during 19 78-79, but Ohio was not 
included in this study that project year. A skill mastery record 
keeping system adopted by the school district was used in Special 
Emphasis. Diagnostic reading test results were available for teacher 
use at this site as were achievement tests and by classroom teachers, 
were available to interested parents and guardians. The Ohio project 
attempted to stimulate parent interest in the development of student 
reading skills through a program focused on parental games and activi- 
ties which contributed to the enhancement of reading skills. Lack 
of interest and participation persuaded project staff to discontinue 
this program following the initial session. Except for a marked 
difference in physical facilities and slight disparity in the available 
instructional materials, as previously noted, the schools at this site 
were comparable. 



The Ohio site was supportive of the evaluation effort. Due to 
circumstances beyond the control of project personnel, all testing 
procedures could not be honored. Table 4.18 reports response rates 
for the various data collection instruments. 

The Ohio project appears to have adhered to all USOE guidelines 
except for some question with regard to participation by students 
in grades 1 and 2. 
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TABLE 4.18 



EVALUATION QUESTIONNAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 



<;lte: nil to 





19 


77'in 


1978-79 




ICH()liaa 1 n 


ChmpArlnrm 


Spcclnl Eviptinnln 


Conpnrifinn 




fitwhcr of 
Reapondcnta 


Population 


Reapondenta 
N/A 


Population 


(ft tube r nf 
ReapoiMlanta 


X of 
Topiilatlon 


NiiMder nf 


Z nf 




I 


JOO 






Renpondenta 


i'opuiatlim 


f rl<tclp;il 


1 


100 


1 


100 










Teacher 


10 


100 


7 


SB 










Keaillnii Specialist 


2 


100 


N/A 












CInnnI f IcAtlnn of 
TCAChing Pmctlccut 

TvAchem 

K«adllnt SpvclalUts 


10 
0 


100 
0 


7 

H/A 


88 










Librarian 


1 


100 


1 


100 










Student ~ Crada 3 


42 


95 


44 


92 










Student - Rrad«v 4-6 


129 


89 


93 


98 










Partfat 


124 




149 












!{tudef«t JnforMaClofi 
ChackllKt 


295 


98 


233 


100 











N/A • Not Appllc«b]« 



Special Features 

There was no evidence of parent involvement at this site through 
spring 1978. Some parents were aware of the program from references 
at PTA meetings. • 

The potential at this site for significant Special Emphasis 
impact on reading skills appeared to be high. A full-time project 
director, creative reading teachers, abundant materials and equipment, 
and a skill mastery management system were exemplary features. However, 
the acceptance and integration of Special Emphasis within the schools 
appeared to be handicapped by the lack of classroom teacher input and 
participation. 



Special Circumstances 

An interesting feature, unique to this site, was the concern for 
the confidentiality of questionnaires. Several classroom teachers 
hand delivered their completed forms to the evaluators, as did the 
reading teachers. This concern is apparently related to the critical 
nature of their comments regarding the program. 

The general atmosphere at the Ohio site was one of uncertainty. 
Desegregation and budgetary issues had everyone speculating about 
future assignments and status. Disgruntled teachers at the comparison 
school filed a union grievance over their role as administrators of ' 
the SDRT. Unable to await resolution, the project director and a 
school district reading supervisor administered the SDRT in this school. 

Summary 

The strengths of the Ohio project were the central office leader- 
ship and support, the creativity of the two reading teachers, and the 
unifying focus of the language experience approach to reading instruc- 
tion. 



The problems were many. In addition to the external influences 
of budget cuts, teacher reduction layoffs, and desegregation orders 
which affected staff morale, problems internal to the project site 
also impinged upon the project. The resentment and lack of cooperation 
on the part of comparison school teachers increased the possibility 
of experimental contamination. Although the Special Emphasis class- 
room teachers appreciated the presence of tha reading teachers, they 
felt excluded from the planning process and thus not a part of the 
program. 

Of the goals initially set by the Ohio project, the first, to 
serve all, was not met; the second, inservice training, was met; and 
the 4-week summer program was also met. These goals, however, were 
simply sta*:ements of Special Emphasis regulations. 



TENNESSEE 



Background 

The Tennessee project schools are located in the rural outskirts 
of a metropolitan area. Many of the families in the area have had 
little contact with the urban environment and are culturally distant 
from the newer families moving into the area as a result of urban sprawl. 
The school district, which served the greater suburban area, was experi- 
encing rapid growth. An ambitious building program and staff recruitment 
effort were attempting to keep pace- Alarmed by the increasingly poor 
performance of its students on standardized reading tests and disappointed 
in the results of Title I, the district applied for a Special Emphasis 
grant. Working on the hunch that the key to improving student performance 
was teacher performance, the project director placed strong, emphasis 
on staff development and on the formative role of the reading specialists 
in the regular classroom. The project was characterized by a thorough 
application of project guidelines and strong project administration. 

Project Schools 

The Special Emphasis school is located in a we 11 -maintained older 
building. Its traditional structure housed a traditionally structured 
education program. Each self-contained classroom averaged 29 students 
during the 1978-79 school year. 

In contrast, the comparison school is housed in a new building 
featuring an open space environment. However, teachers separated their 
individual class units by using barriers such as book cases and portable 
blackboards. Classes averaged 23 in this school during 1978-79, consider- 
ably fewer than the experimental school. 

Both schools served kindergarten through eighth grade students; 
however, all enrollment and staff data gathered for the purposes of 
this study were for grades 1 through 6. Students in the two schools 
came from the same geographical area and eventually attend the same 
high school. The experimental school enrollment was larger than the 
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comparison school's; there was also a higher percentage of black students 
in this population than at the comparison school. Both schools qualified 
for, and received, Title I services. Table 4.19 summarizes student 
enrollment data for school years 1977-78 and 1978-79. No significant 
changes were noted from one year to the next. 



TABLE 4.19 
ENROLLMENT CHARACTERISTICS 

sice; TENNESSEE 



School: 


Special Enphasls 


Comparison 


Project Year: 


1977-78 


1978-79 


1977-78 


1978-79 


Number of Students 


335 


314 


213 


207 


By Sex: 










Male 


51Z 


502 


552 


552 


Female 


49% 


502 


452 


452 


By Racial/Ethnic Categories: 










Black 


742 


712 


522 


532 


White 




292 


482 


472 


Hispanic 










Other or uncategorized 




* 




* 


Students Receiving Free or 
Raduced->Prlce Lunch 


81Z 


792 


732 


622 


Students for Whom English 
la a Second Language 




* 




* 


Students Absent More 
Than 25Z 


52 


22 


22 





* 

Less Chan .52 

Rounding escimaces are responsible for column cocals below or above 1002. 
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The staff of the experimental school was slightly larger than 
the comparison school's staff. Experimental teachers had twice as 
much teaching experience as comparison school teachers, who were appar- 
ently younger and more recently trained. The percentage of teachers 
holding graduate degrees, however, was almost identical. Table 4.20 
summarizes staff characteristics for school years 1977-78 and 1978- 
79. These data show little change over this time period. 



TABLE 4.20 
STAFF CHARACTERISTICS 



Slc«!TPfflESSEE 



School: 


Special Esphaels 


Camparis on 


Project Tmt: 


1977-78 


1978-79 


1977-78 


1978-79 


Number of Teachttrs 


12 


11 


9 


9 


Teachers vlth Graduate Degraaa 


212 


26Z 


20Z 


33Z 


Avarast Tamchar Expariance 


16 jrrs. 


15 yrs. 


7 yrs. 


7 yrs. 


Avaraga Nu^ar of Students /Clasj 


28 


29 


24 


23 



Excluding Special Emphasis staff, the experimental school had 
a total of three reading specialists—one Title I and two funded by 
the Emergency School Assistance Act (eSAA) . The comparison school 
had two reading specialists— one Title I and one ESAA. Both schools 
had the services of a librarian, nurse, speech teacher, physical educ 
tion teacher, psychologist, and social worker. In addition, the com- 
parison school had a music teacher on its staff. 
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Both schools had classroom aides assisting with reading instruc- 
tion. There were five aides in the experimental school; each reading 
specialist had an aide and grades K through 3 shared two aides. The 
two reading specialists at the comparison school each had an aide. 
These two aides also worked directly with classroom teachers as time 
and needs dictated, 

A comparison of the reading programs at these two schools reveals 
notable differences. During the 1977-78 school year, the treatment 
school used DISTAR as its primary instructional strategy. This program 
monitors student progress through skill levels; regrouping based' upon 
outcome measures takes place frequently. A basal text was used as 
a supplementary resource. In 1978-79, DISTAR and the basal were installed 
as co-equals. On the other hand, the primary instructional strategy 
at the comparison school was the basal text series through 1977-78. 
In 1978-79, DISTAR was introduced in the comparison school and used 
in conjunction with the basal. 

Neither school had a wealth of materials or equipment for use 
in reading instruction. Teachers generally had the district-adopted 
text, DISTAR materials, and some audiovisual equipment at their disposal. 
They improvised or created other teaching materials for use with their 
students . 

With respect to the instructional orientation of the teachers 
(Table 4.21), teachers in both schools claimed to take a diagnostic- 
prescriptive rather than whole-class approach. By the end of the project, 
both schools had a balance with respect to structured and moderately 
structured teaching styles. A review of teacher questionnaires completed 
in 1978 and 1979 reveals that a higher percentage of comparison school 
teachers in 1978 used individualized instruction as a primary grouping 
strategy than Special Emphasis teachers (45% vs. 14% in the treatment 
school). However, this difference evened out in 1979. 
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TABLE 4.21 
CLASSIFICATION OF TEACHING PEIACTICES 



Slc« : TENNESSEE 





• 1977-78 


1978-79 


Special 
Eaphaslff 


ComDsrison 


Spttdsl 

Enph*wi» 




DlaKnosclc Approach 


» Z* 


N 


Z* 


N Z* 






PrMcripcive 


10 


91 


8 


89 


9 


82 


8 


89 


Eclectic ^ 


0 


0 


1 


11 


2 


18 


1 


U 


Whoitt Class 


1 


9 


0 


0 


0 


0 


0 


0 


Mtnawaanc Style 


















Struccur«4 


9 


82 


5 . 


44 


6 


55 


5 


56 


EcJLeccic ^ 


2 


18 


3 


4A ' 


5 


45 


4 


44 


* 


0 


0 


1 


11 


0 


0 


0 


0 



Based on cha nuabar of claasroov caachars respoiullng. 

"^Tha dsaignaclon ^iSdactic" ladlcacaa a caachlng which coiabiasa eleoancs from 
both approaches or styles. 



The Special Emphasis Progr am 

, The overall objectives of the Tennessee project were: 

• To operate an intensive reading project that will facilitate 
pupil growth and lend itself to evaluation. 

• To operate a project which demonstrates a balanced, flexible 
approach to teaching reading in the diagnostic-prescriptive 
mode. 

• To provide inservice training to instructional staff and 
aides • 
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• To encourage parent/conmunity involvement by providirg 

structured activities, information, and opportunities for 
participation. 

An additional objective was specified for the final project years 

to operate a project which will provide residual benefits once funding 

ends. 



The Tennessee project operated smoothly throughout its duration. 
The treatment and comparison schools reported no major problems as 
a result of their participation in the study. However, the treatment 
school found it difficult to schedule classroom and reading lab time 
around the many other special programs operating in the school. Both 
schools cooperated fully with the evaluation effort, diligently subscri- 
bing to the testing protocol and coding requirements. 

Involved in planning the overall reading program at the Tennessee 
treatment school were the project director, the principal, reading 
specialists, and several teachers. On the individual class level, 
reading instruction and student grouping were determined by the classroom 
teacher and the respective reading specialist. 

Pr oject Staff 

Tnree reading specialists were assigned to the Special Emphasis 
Project. Two were with the project throughout its duration; one turnover 
occurred midway through the final year. All specialists had master's 
degrees and a minimum of 8 years of teaching experience. One specialist 
served grades 1 and 2. The remaining two, served grades 3 through 
6. 



Three aides served the project, one assigned to each specialist. 
Aides were supervised by the reading specialists and the principal. 
Formal training was provided through the Special Emphasis inservice 
program and individually by each specialist. Aides' duties included 
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preparation of instructional materials and small group remedial and 
follow-up instruction. In addition, a clerical aide provided record 
keeping and support services for the project. 



The Special Emphasis Treatment 

At the onset of the Tennessee project, reading specialists provided 
intensive reading instruction independently of the classroom teachers. 
Midway through the first year, the program was restructured to have 
project personnel teach cooperatively with the classroom teachers. 
This caused some confusion and delay in project services. However, 
once the change was completed, the project operated smoothly. 

Reading specialists and aides worked in pairs. Throughout the 
morning, they moved from classroom to classroom to work with each class 
during its regularly scheduled reading period. During the afternoon, 
groups of students reported to the specialists' classrooms where they 
received corrective instruction in specific skills. As implemented 
at this site, Special Emphasis was, in fact, serving most of the student 
body. Table 4.22 summarizes project participation figures for project 
years 1977-78 and 1978-79. 



TABLE 4.22 
TREATMENT GROUP SIZE BY GRADE LEVEL* 



Sie«: TENNESSEE 





Prts:iect Year 


1977-78 


Prolect Ym»r 1978-79 




Total 
EnroUaent 


Z Served By 
Special Eaphaala 


Total 
EnroUtaent 


Z Served By 
Special Emphaala 


Gradft 1 


54 


100 


48 


100 


Gradft 2 


53 


100 


46 


100 


Grade 3 


58 


83 


55 


62 


Grada 4 


45 


100 


64 


59 


Grade 5 . 


59 


100 


45 


51 


Grade 6 


66 


80 


55 


16 ! 

i 



*Ba»ed on Experimental School Principal Questionnaire. 
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In grades 1, 2, and 3, a total of 90 minutes was devoted to reading 
instruction daily. Of this time, half was in the classroom with the 
teacher, reading specialists, and aide present. The remainder was 
provided by the specialist and aide in the reading lab. Grades 4, 
5, and 6 received 105 minutes of language arts instruction each day 
during which the classroom teacher, specialist, and aide jointly provided 
a 45-minute period of reading instruction. Students requiring remedial 
work went to the lab for an additional 45 minutes of instruction each 
afternoon. The remain\ng language arts time was devoted to spelling, 
grammar, etc« 

As prescribed in the Special Emphasis guidelines, mastery of 
reading skills was tracked for each student. Two record keeping systems 
were employed. Overall progress was assessed by Individual Criterion 
Reference Tests (ICRT), compiled by Educational Development Corporation. 
A multipage printout reflecting skill mastery and deficiency was avail- 
able for each student. These skills were correlated to the school 
reading program materials (DISTAR, Houghton Mifflin) to assist teachers 
in keying their instruction to meet student needs. Houghton Mifflin 
criterion referenced tests were regularly administered and student 
skill mastery charted. This information was used to establish progress 
and determine instructional needs. 

Staff schedules provided daily planning periods for all teachers 
and specialists. While these periods were not exclusively used for 
planning reading instruction, reading specialists met at least weekly 
with teachers to discuss progress and/or jointly develop instructional 
plans. For grades 1 through 4, assessment and information exchange 
occurred daily on an informal basis. Coordination between specialists 
and classroom teachers, as reported by both, was high. 

Use of Materials 

The major change introduced to the treatment school's reading 
program during the Special Em,^hasis Project was the use of DISTAR, 
a reading instruction management system. Students in grades 1 through 
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6 were exposed both to DISTAR's programmed materials and the basal 
reading aeries (Houghton Mifflin). In some classrooms, the teacher 
used the basal instructional program while the reading specialist or 
aide used DISTAR; in others it was reversed. There was agreement among 
teachers across all grades that the materials available for reading 
instruction were adequate to serve student needs. In cases where there 
were not enough items to permit each teacher to have his/her own, they 
were willingly shared. However, teachers did express a preference 
for individual student workbooks rather than the master ditto sheets 



in use. 



Inservice Training Program 

la 1976-77, all teachers involved in the Special Emphasis Project 
participated in inservice training. The foci for staff development 
during this project year were: mastery of reading program objectives, 
implementation of a diagnostic-prescriptive approach to teaching reading, 
interpretation of assessment and evaluation data, and the preparation 
of support materials. The project director, reading specialists, and 
principal collaborated on preparing and conducting this program. In 
addition, a weekly course, naught by an outside consultant, was provided. 
The inservice programs in 1977-78 and 1978-79 were an extension of 
the one held the first year, and all teachers participated. Teachers 
reported that the inservice program was "somewhat helpful" in enhancing 
their classroom reading instruction. The teacher inservice component 
to Special Emphasis was one of the major factors motivating this project 
site to apply for Special Emphasis funds. 

Summer Program 

The 4-week summer program conducted by the Tennessee site in 
1978 was divided into a 4-day "work" week of intensive learning from 
8:45 AM to 12:00 PM and a 30-minute reading pariod in the afternoon. 
Fridays were activity days usually reserved for field trips. Events 
on activity days were incorporated into the language experience part 
of classroom instruction. The program served 225 students. 
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Program objectives were: 

• To retain and expand pieviously learned language and reading 
skills. 

• To promote skills development in areas of student deficiency. 

• To broaden student interest by providing enrichment activi- 
ties and experiences, 

• To provide teachers with an opportunity to experiment with 
innovative teaching methods/approaches. 

Staff was comprised of three reading specialists, who coordinated 
and provided sir.pport to classroom teachers; 13 teachers, who instructed 
groups of 8 to 24 children; and three aides associated with the regular 
school year program. Each day, one to three volunteers provided assist- 
ance to the arts and crafts classes. In addition, several teenage 
girls, not eligible to participate in the summer program, volunteered 
their time as general aides. 

Along with commercially prepared basic reading kits, teachers 
used locally developed instructional materials selected from workshops 
held durirg the school year. Much of the material chosen for the 1978 
summer program focused on the development and/or strengthening of compre- 
hension and decoding skills. 

Program plans were developed before and during 3 days of inservice 
sessions with teachers. The summer program was an extension of the 
regular school program. Progress in reading v/as to be determined by 
comparing a student's spring Metropolitan Reading Test scores with 
those obtained in the fall. 

Supervision of the program was provided by the experimental school 
principal and the project director. The principal was responsible 
for administration, management of the buildings, supplies, and class 
and bus scheduling. The project director served as trouble shooter 
and spent much time with project staff during the planning phase, and 
attended to central office administrative issues. 
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Outstanding features of this program were its highly organir.ed 
structure, the active parent participation, the program's outreach 
efforts to involve the nonactive parents, and the rewar of a paperback 
book each week for participating students. 

The Tennessee; sunmier program in 1979 was similar to the previous 
year, except for a slight drop in enrollment. Three additional classroom 
teachers were added and three fewer aides were hired. 

A summary of summer prograia statistics for 1978 and 1979 is found 
in Table 4.23. 



Compliance with Special Emphasis Guidelines 

The Tennessee project was in compliance with all but one of the 
established guidelines— the selection of matched treatment and comparison 
schools. As noted, the schools differed markedly with respect to demo- 
graphics, faculty, class size and facilities.^ In all other aspects, 
this site was in compliance with the guidelines. 



serveu 



The project was staffed by three reading specialists who 
the entire student body, grades 1 through 6. Students having reading 
problems received additional attention. Instructional time exceeded 
the sinirnum estai;Xished in the guidelines and that received by students 
in the comparison school. Test data, diagnostic and achievement, were 
available to teachers and parents/guardians as prescribed in the project 
guidelines • 



1_ . 

Recent studies on the influence of open space classrooms on student 
outcomes have been inconclusive. However, the studies do indicate 
that teachers in these environments tend to differ from teachers in 
conventional classrooms through seH-selection in that they exhibit 
more interaction with other teachers; have greater feelingflt of auton- 
omy, satisfaction, and ambition; spend less time in routine activi- 
ties; and place greater importance on evaluation by their colleagues. 
Data regarding differences in use of student-centered instruction 
and variable size groups are not clear. See Carol S. Weinstein, 
"The Physical Environment of the School: A Review of the Research." 
Review of Educational Research^ Fall 1979, 49: 4, 577-610. 
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TABLE 4.23 
SUMMER PROGRAM SUMMARY 



Progrn Duration 
Hours par day 



Xaacrueciosal hours In raadlng 
and raadlng-raUcad «celvltla« 
(houra par day) 



Suamar 1978 



4.0 
4.0 



3.5 



Suanar 1979 



4,0 
4,0 



3,5 



Total School Enrollmnt 



335 



314 



SuKaar School EnroUaant 
Farcant of Total EnroUaant 
Taachar/Adult-Studant Ratio 

t;taf.* 

Baading Spaclal^ata 

Taachari 

Mdaa 

Llbrarlana 

Gya/Art Taachar 

Volvntaara^ 



225 
67 
1:13 



3 
13 
3 
0 
0 

3 (parents) 
3 (students) 



190 
61 
1:9 



3 
15 
3 
1 
0 

3 (parents) 
3 (students) 



* - 

7ol<ffltaars not indudad In conputlng Taachar/Adult-Studant Ratio. 
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A summer program was conducted each project year which included 
the operation of an inexpensive book distribution program, broad-b.^sed 
community participation, and activities designed to stimulate interest 
in reading. 

A formal Inservice training program was designed to meet teacher 
needs and included participation by an outside consultant. Reading 
program planning included the participation of parents, aides, and 
students in addition to those traditionally responsible for this task. 
The skill mastery record keeping systems in use (DISTAR, Houghton Miffl 
were initiated by Special Emphasis. 

Project personnel were fully responsive to all evaluation study 
requirements. Table 4.24 reports response rates to the data collection 
instruments for each respondent group. 



TABLE 4.24 
EVALUATION QUESTIOMAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 



51 K«; TRNKKSSa 



R/A • Not AppLleaHla 



BEST 



4-59 



98 





19 


^7-78 


1978-79 


SK>ecial 


KaphiMla 


Gb«iparLRfNi 


•*ip«cCNl Enffumla 


Oimfimrtmon 




Ni«il>«r of 
Kaapon^tnta 


Z nC 
_PopuIat*on 

100 


Kti«N>r of 
Renpondanta 


X of 
fopiflatloo 


Raapondrnta 


X of 

ror-uiAtion 


Hu«h4>r of 
RcBpondfiiiCa 


z or 
ropuUdon 


Trolvct Dirtctor 


1 


N/A 




1 


100 


N/A 




Principal 


I 


100 


I 


icn 


1 


100 


\ 


100 


Taachcr 


12 




9 


100 


11 


100 


9 


100 




S 


too 


2 


100 


6 


100 


0 


• 0 


CtMNlf ICNtinft f>r 

T«Ac4ili»R Pmctlcmi 
T»Mclt«r« 


11 

I 


92 

t y 


9 
1 


100 
30 


11 
6 


100 
100 


9 
0 


100 

0 


LlbrariM 


1 


100 


1 


100 


1 


100 


I 


100 


Studaqt - Crada :i 


58 


too 


42 


98 


^5 


100 


32 


100 


StMdtNC - Cradaa 4-6 


167 


98 


93 


96 


151 


92 


95 


87 


farant , 


279 




165 




297 




196 




Vtrwtwnt TnforiwitloR 


J27 


98 


209 


98 




97 


207 


I mi 



Special Features 

Special Emphasis reading specialists served as resource persons 
and role models throughout the project. In addition to jointly planning 
the reading program and actively participating in the regular classroom 
instruction with the teachers, they provided remedial services, and 
inservice training. 



The school librarian reported performing a wider variety of Casks 
with the beginning of Special Emphasis, regular contact with classroom 
teachers, and more involvement in the school's instructional effort. 

The Tennessee project attracted more parent support than any 
other Special Emphasis site; in fact, more than the treatment school 
had known before. Parents were regularly informed and updated about 
the reading program and activities through a school newsletter. The 
project director, principal, and reading specialists used PTA meetings 
to inform and report to parents on the program. In addition, the school 
open house and parent conferences provided opportunities to focus on 
the project and student progress. The summer vacation reading program 
was a vehicle for parent participation. 

Special Circumstances 

No special circumstances existed at the Tennessee site. 
Summary 

The strengths of the Tennessee project were the strong organiza- 
tional management provided by the principal, the close planning and 
coordination between reading specialists and the experimental school 
staff, and provisions for staff development. Its weaknesses were 
differences between the treatment and comparison school Including 
instructional setting, class size, instructional materials, and student 
demographics . 

By the end of the project, it was the consensus of project per- 
sonnel and experimental school classroom teachers that the original 
objectives set for the project had been achieved. According to these 
staff, the most notable evidence was improvement in reading achievement 
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on the locally administered Metropolitan Achievement Tests. ^ Teachers 
also reported that, by the end of the project, they were aware 
of and were using a greater variety of teaching methods and materials 
to meet student needs. 



CM. Achilles, J. Ray, H. O'Leary, and H. Cr-anp, Analysis of t he 
Tennessee Special Em phasis Proiect . paper presented to the ann^l 
meeting of the American Educational Research Association. San Francisco. 
California, April, 1979. 
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TEXAS 



Background 

The Texas project site is located on the outskirts of a large 
urban area. Once rural, this community has experienced rapid growth 
in the last 15 years. The student population is almost 7 times larger 
than it was 15 years ago. Although there is little industry to provide 
tax support to the district, growth has been stimulated by the presence 
of a large university, a medical center, and three military bases. 

Project: Schools 

The physical facilities of the treatment and comparison schools 
are similar. Both school buildings are large, modem structures with 
self-contained classrooms housing kindergfirten through fifth grades. 
The general upkeep of the buildings and grounds at both schools was 
good. Students, grades K through 5, were served at each building. 

A substantial number of students, between 39% and 50%, at the 
two schools was Hispanic, This was the only Special Emphasis site 
requiring bilingual materials and resources, of the remaining student 
population, the majority was white. Table 4.25 shows student enrollment 
characteristics for school years 1977-78 and 1978-79. 

The comparison school had more students and, consequently, more 
classroom teachers than the treatment school. The level of experience 
represented by the two faculties was almost identical. However, a 
greater percentage of teachers at the treatment school had graduate degrees 
than at the comparison school. The student-teacher ratio at both schools 
was almost identical. Table 4.26 summarizes staff characteristics. 

A full complement of specialists was assigned to both schools. 
This included learning disabilities and reading specialists; speech, 
music, and physical education teachers; counselors; and a part-time 
nurse. Aides at each school, three at the treatment and two ac the com- 
parison, provided general assistance to kindergarten and special education, 
teachers • 



TABLE 4.25 
2NR0LLMENT CHARACTERISTICS 

Site : TEXAS 



1 

1 School: 


Special Eophasls 


Conr arisen 


Project Y©«r: 


1977-78 


1978-79 


1977-78 


1978-79 


Number of Students 


541 


538 


o JO 


Oil 


By Sex: 










Mele 


S4Z 


522 


50Z 


49Z 


Fenele 


46Z 


482 


50Z 


51Z 


By Reciel/Ethnlc CAtegorles: 












5Z 


5Z 


9Z 


8Z 


White 


4SZ 


42Z 


52Z 


44Z 


Riepaolc 


48Z 


50Z 


39Z 


46Z 


Other or uncAtegorlxed 


21 


4Z 


< IZ 


2Z 


Students Baceiving Free or 
Reduced*Prlce Lunch 


44Z 


60Z 


39Z 


41Z 


Students for Whoa English 
Is e Second Language 


16Z 


18Z 


12Z 


17Z 


Students Absent More 
Then 25Z 

' 


2X 


2Z 


4Z 


4Z 



Rounding ftsclJBaces are responsible for coluim totals below or above lOOZ. 



TABLE 4.26 
STAFF CHARACTERISTICS 

Site TEXAS 



School: 


Special Eaphasis 


Comparison 


Project Year: 


li77-78 


1978-79 


1977-78 


1978-79 


Number of Teachers 


21 


21 


25 


23 


Teachers with Gradtiate Degreaa 


19Z 


25Z 


12Z 


9Z 


Average Teacher Experience 


7 yrs. 


6 yrs. 


7 yrs. 


8 yrs. 


Average Nioiber of Students/Class 


26 


26 


26 


27 
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Both schools received Title I services. An oral language program 
operated at the schools and was funded through Title I. This was a pull- 
out program serving thosa students experiencing oral communication 
problems. The school r'i^=t: ict had assigned a reading specialist to 
each school. At the prcr: c school, this specialist worked in conjunc- 
tion with the Special : .asis project staff. At the comparison school, 
this specialist was responsible for screening and testing students; 
providing remedial, small group instruction; and acting as a consultant 
to teachers, grades 1 through 5. 

Each scho'Jl used the Houghton Mifflin basal reading series. To 
augment this material, teachers used commercially available kits, games, 
trade books, programmed materials, workbooks, and audio materials. Both 
schools had well supplied resource rooms. When asked if the materials 
available for teaching reading were adequate to meet their students' 
needs, teachers at both schools overwhalmingly (70%) answered "yes." 

The results of the Classification of Teaching Practices question- 
naire (Table 4.27) showed consistent differences in the instructional 
styles of the faculty in the Special Emphasis and comparison schools. 
Project school teachers were more diagnostic-prescriptive in their 
approach. A review of the data on the teachers' questionnaires showed 
that project school teachers made greater use of small group instruction 
than their comparison counterparts. 

At the the Special Emphasis school, the regular reading program 
was conducted within each teacher's classrootn. Daily instructional 
time amounted to 80 minutes for grades 1 through 5. At the comparison 
school, a modified Joplin Plan utilizing specialty area teachers in 
math, science, and language arts was followed. As part of this plan. 



■'■"Pull-out" refers to the practice of removing one or more students from 
the regular classroom to receive special instruction or undertake 
special activities. 
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students were assigned to classes according to ability during their 
reading period. Grades 1 and 2 spent 90 minutes in reading instruction 
dally; grade 3, 75 minutes; and grades 4 and 5, 60 minutes. 



TABLE 4.27 
.CLASSmCATION OF TEACHING PRACTICES 

Sitft : TEXAS 



OriftntAtioii 


1977-78 


197a-79 


Sp«c1a1 


ConpATlson 


Sptelal 


ComPArlflon 




N Z* 




X* 


N 




JL 


Jl 




16 


76 


10 


40 


15 


75 


9 


39 


Eelaetle ^ 


3 


14 


10 


40 


5 


25 


10 


43 




2 


9 


5 


20 


0 


0 


4 


18 


Struettmd 


17 


81 


20 


80 


17 


85 


17 


74 


EcXsetle ^ 


4 


19 


4 


16 


3 


15 


6 


26 




0 


0 


1 


4 


0 


0 


0 


0 



BMftd on thm naab^t of cljusroom taachftra rMpondiag. 



Thft dMisnacloa "Edtetle" ladieatts * tft«ching orlcncatioa which 
coabloAs ftlflMncs froa bonh approachM or stylM. 



The Special Emphasis Program 

The Special Emphasis Program at the Texas site set the following 
goals at the outset of the project: 

• To provide intensive reading instruction to all first and 
second grade students by a reading specialist, classroom 
teacher, and aide. 

• ^ To provide instructional help by a reading specialist to 

all third through sixth grade students experiencing diffi- 
culty in learning to read or reading below grade level. 
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• To increase teacher proficiency in diagnosing and prescribing 
the reading needs of students. 

To accomplish this latter goal, a rigorous inservice training program 
was conducted. In addition, during the final year of the project, this 
site focused on reinforcing those approaches and practices which reading 
specialists had modeled in the regular classroom. Classroom teachers 
assumed greater responsibility for student grouping and management of 
the reading program and activities. 



Project Staff 

The Texas project was directed by a school district reading super- 
visor who also had numerous other responsibilities. Despite the limited 
amount of time she devoted to project activities, her administrative • 
and programmatic leadership was evident. Day-to-day coordination of 
project activities was provided by the lead reading spseialist. The 
project team consisted of six reading specialists, five aides, and one 
clerk. As of fall 1978, all reading specialists had graduate degrees. 

The Special Emphasis TiTtjataant! 

Reading specialists at this site played a major role in the regu- 
lar classroom reading program, in conjunction with first and second 
grade classroom teachers, they planned the basic instructional approach, 
grouped students, and conducted dailv instructional activities. They 
selected and supplied materials and equipment to enhance each classroom 
program. An aide and specialist worked alongside the classroom teachers 
during the regular reading period. In addition, they returned to the 
classroom in the afternoon to work with individuals or a small group 
of students to reinforce learning. This arrangement necessitated a 
high degree of cooperation and coordination between reading specialists 
and primary grade teachers. 



For, grades 3 through 5, reading specialists worked with small 
groups of students in a lab-type classroom. Instruction was aimed at 
correcting skill deficiencies. The regular classroom reading program 
was conducted by the classroom teacher independently. Little evidence 
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of coordination and/or planning between teachers and specialists was 
found in these grades. However, specialists attempted to keep teachers 
informed of the progress of those students they served. 

In addition to materials preparation, teacher aides worked with 
small groups of students in grades 1 and 2. Students in grades 3 
through 5 who needed remedial help received individualized attention 
from project aides. 

Table 4.28 shows the percentage of studeuts of the total enrollment 
served by Special Emphasis at the Texas site* 



TABLE 4.28 
TREATMENT GROUP SIZE BY GRADE LEVEL* 



Sit« TEXAS 





Proleat Ya«r 


1977-78 


iTOlect Year 197S-7Q 




Total 
E&rollJM&t 


X Sftrvttd By 

Special EaohMls 


Total 
EnroUatnt 


I i^ervtd By 
Special EmDhaeie 


Gradtt 1 


125 


79 


104 


100 


Grftdtt 2 


120 


80 


110 


100 


Gradtt 3 


107 


A7 


126 


45 


GraiU A 


100 


50 


98 


35 


Grade 5 


90 


62 


100 


48 



Baaed on Experimental School Principal Ouestlonnalre. 



Use of Materials 

In Texas » the basal reading series was the major resource for 
specialists working in grades 1 and 2. Teacher-developed and connnercial 
skill activities along with trade books were the primary resources for 
specialists serving the higher grades. 
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Audiovisual equipment used most frequently to supplement basal and 
special reading materials included tapes and listening stations. Other 
equipment less routinely used included movies, overhead projector, 
language master, and tachistoscope . 

The Texas site used a district developed skill mastery checklist 
to track student progress. Following testing at the onset of the school 
year, worksheets for each student were filled out reflecting skill 
attainment. These worksheets were updated as the student progressed. 
Reading specialists maintained a duplicate worksheet for students 
receiving Special Emphasis instruction in grades 3 through 5. 

Inservice Training 

Aides received special training in conjunction with the project. 
Training at the Texas "site focused on diagnostic-prescriptive activi- 
ties, design of motivational activities, development of instructional 
materials, and specific skill development in small group settings. 
Each aide received training in various kinds of remedial reinforcement 
activit'.es. Aides appeared to, be very effective in performing the tasks 
for which they had bee>n trained. 



All teachers at the project school participated in the inservice 
training program. The 20 hours of instruction were designed to 
answer specific program needs and emphasized: implementation of a 
diagnostic-prescriptive appro.-ch to teaching, preparation of support 
materials, evaluation of student progress, and interpersonal relations. 
Sessions were conducted by an outside consultant from a nearby university, 
the project director, and several Special Emphasis reading specialists. 
Teachers felt this training was "somewhat helpful" in enabling them to 
carry out their reading program activities. 

The Texas project director conducted a training program for 
interested parents on ways they could become involved in the school 
reading program and help their children. As a result, seven parents 
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volunteered to as:iilst at school. They helped design motivational 
activities, developed mate?:ials, tutored students In other content areas 
and provided small group Instruction In specific skill areas . Because 
this school district was phasing out the employment of classroom aides, 
It was hoped that the parent volunteer could provide some services 
which would otherwise be discontinued. 



Summer Program 

The Texas slte» which conducted a 4-week: summer session, had 
a total enrollment of 106 students In 1978. The program ran for 3 1/2 
hours each day. This time was divided Into 30-minute periods. Each 
period, students participated In one of -he following activities: 
directed teaching of reading skills, language experience, listening 
skills, independent reading, skills reinforcement, library or arts and 
crafts period, and physical education. Special activities, such as 
field trips and special entertainment programs were held on Fridays , - 

The objectives of the program were: 

• To upgrade the reading level of children functioning 
below grade level. 



To promote a positive attitude toward reading. 



Teaching staff consisted of six reading specialists and six aides 
from the regular school year. All aides had at least 1 year of college. 
Twenty student interns from the University of Texas provided voluntee.: 
support for the program. Interns, who were Juniors or Seniors majoring 
either in education or reading, provided 2 houis of effort each day. 

The staff developed some materials but railed heavily on pre- 
developed materials from Harcourt Brace, Houghton Mifflin, Scholastic, 
and others. A number of audiovisual aids supplemented these instruc- 
tional tools. A skills test, devised by the schoo]. district, was 
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administered to a child whenever a teacher felt that he/she had mastered 
a skill. Attendance for the summer session was 20% of the school year 
enrollment. 

The 1979 summer program cocninued the same format and schedule as 
in 1978. The staff added one objective to those listed: to provide 
students with additional instruction in comprehension and vocabulary 
building. 

Student interns did not participate in the 1979 summer reading 
program. Program statistics for 1978 and 19 79 are contained in Table 4.29, 

Compliance with Special Emphasis Guidelines 

The Texas project was reviewed for compliance with the legislation 
and' the USOE regulations and was found to be in compliance with the 
major provisions and within the limitations cited for the recommended 
provisions. 

Reading specialists who met USOE requirements were assigned to 
the project school. All first and second graders in 1978-79 received 
instruction by the specialists and those having problems in 'reading 
received additional aid from the specialists aa well. Students in 
grades 3, 4, and 5 having reading problems received instruction by 
project personnel. Student instruction in reading exceeded minimum 
time requirements; however, at the comparison school, students in 
grades 1 and 2 received a greater amount of instruction (10 minutes 
daily). A summer program operated each project year as did a formal 
inservice training program which utilized an outside consultant. Program 
planning was largely a district administration task; little participa- 
tion on the part of teachers or others occurred. Parents were involved 
in the program as tutors. Diagnostic and achievement testing took place 
on a systematic basis with the results available for teacher use. 
Intereste'd parents /guardians were notified that they could request 
information and interpretation of their child's record keeping system. 
Activities to stimulate interest in reading which involved students. 
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TABLE .^.29 
SUMMER PROGRAM SUMMARY 



Sit* TEXAS 



Progrvi Duration 
Eoars pvx dsy 



ir 1978 



4.0 
3.5 



Sua— r 1979 



4.0 
3.5 



Znatnietioiul hour« In rMding 
nd rtadins rftXsctd accivitlM 
(hourtf par day) 



local School EaroUmnc 



Sdiool EnroUamt 



3.0 



541 



106 



2.5 

538 
123 



Parcant of Total Enrrllamt 



20 



23 



taachar/Adull'.-Studont Ratio 



1:3 



1:10 



Staff 

Saadlns Spaeialiata 

taaehara 

Aidaa 

Librariana 
Gym/Art taacher 
Voluntaara 



6 
0 
6 
0 

0 

20 student interns 



6 
0 
C 
0 
0 
0 
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parents, and broad ased participation of school personnel aad officials 
were neither reported nor observed. Treatment and comparison schools 
were fairly well matched, except for using disparate approaches to 
reading instruction. Project staff extended their full cooperation 
to the study team and to the evaluation effort. Incidental coding and 
test administration errors occurred and were noted in Section 3. 
Table 4.30 presents response rates for each of the respondent groups 
in this site. 



TABLE 4.30 

EVALUATION QUESTIONNAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 



Slca: ItXkt 







1971-79 






CcM|MirlllM 


Sp«ci«l Ea|itia»l« 


Coa^arisod 






Z of 
I'upulaclun 


MuNter of 
fUspomlanca 




ItlMbtfT of 

R«ap<inJ«jtca 


X uf 
Populaciott 


Nua6«r of 

H«afttti|fl^af a 


X of 


fruUcc Ulrcccur 


1 


100 


H/A 




1 


100 


Hfk 






1 


100 


1 


100 


1 


100 


1 


100 


T««clt«r 


21 


100 


U 


100 


20 




21 


100 




7 


100 


1 


SO 


7 


100 


2 


lUO 


T«at:l)lMft i*rMCClC4tat 
T«aclMir» 

MaaillAK Sp«cUUaCS 


21 
7 


lOO 
lOO 


25 
0 


IOC 
0 


20 
7 


9S 
100 


21 
0 


100 
0 


Mbrarl#^ 


1 


ICO 


1 


100 


i 


100 


1 


100 




9tt 


91 


124 


93 


124 


100 


lift 


94 




1114 


97 


22B 


92 


19S 


91 


21 S 


92 




426 








59 1 




. 43J 




afci«a«ac InforMclM 


S3a 


n 


fa(M 


9i 


SIO 




411 


100 



N/A - »BC A^pllc«kl« 



. Special Features 
The major thrust of the Special Emphasis project in Texas was 
found in grades 1 and 2. Personnel and material resources were concen- 
trated at these levels. Reading specialists and aides worked within 
the structure of regular classroom units with the classroom teachers. 
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felt that their teaching responsibility had been usurped. Sensitive 
to the hostility toward them and the project, the reading specialists 
attempted to establish cooperative working relationships with the 
teachers they served. With the specialists confining their roles to 
those that would conq)lement the teacher-. * skills, classroom teachers 
were reassured of their own capability as teachers. Rather than the 
reading specialists "running the show," teachers and specialists 
planned and worked as a team. 

During 1977-78, this new arrangement functioned smoothly. Teachers 
accepted the presence of the reading specialist in the classroom and 
accepted and integrated their suggestions, ideas, and advice regarding 
classroom management, instructional techniques and practices, and the 
use of materials. Reading instruction became a co-venture. 

In 1978-79, project personnel made an effort to shift the full 
responsibility of decision making and planning with respect to reading 
to the classroom teacher. Reading specialists concentrated their efforts 
on reinforcing the application of a diagnostic-prescriptive approach 
to reading and on the development of creative learning and reinforcement 
activities. 

Strong administrative support, both from the district and the 
experimental school principal, was evident. Keen interest in the 
Special Emphasis Progr,m and reading in general was also evident. Both 
the eKperimental and comparison schools had exceptionally well stocked 
and v^ll organized materials centers. These materials appeared to be 
circulated and used by teachers in their reading programs. 

Special Circumstances 

The principal of the comparison school looked upon the Special 
Emphasis project as a competition between his school and the experimental 
school, fiovev^r, the extont to which this influenced teachers and 
students is not known. 
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Due to misunderstanding, several coding and testing problems arose 
over the course of this study. First grade students were not administered 
subtests four and five of the SDRT during the spring 1978 testing. Coding 
on staff questionnaires was incomplete in spring 1979 and student identi- 
fication numbers were duplicated. This last error was corrected by 
project staff, thus salvaging the SDRT data. 

The school district at this site offered an inservice training 
program for all teachers. Both mandatory and optional sessions were 
held. Consequently, teachers at the comparison school received staff 
development opportunities equal to those at the Special Emphasis school. 



Summary 

After its initial adjustment period, this project reflected a 
high level of teamwork between the Special Emphasis staff members and 
between the staff and classroom teachers. The close collaboration 
fostered two objectives: reading specialists provided instructional 
support to the classroom teachers, and specialists served as models for 
reading attitudes and practices for teachers and students. 

The Texas site met two of its three objectives stated at the 
beginning of the project. By 1978-79, they were serving all first 
and second grade students and those in grades 3 through 5 needing 
special help. With respect to increasing teacher proficiency in diag- 
nosing and prescribing the reading needs of students (the third objec- 
tive), there are no definitive data. However, 70% of the teachers saw 
improvement in their colleagues attitudes toward reading. 



WEST VIRGINIA 



Background 

A rural, nsountainous, coal producing area of West Virginia is 
the site of this Special Emphasis Project. The community is comprised 
of close-knit groups who have resided in the area for many generations. 
Mother-daughter, husband-wife combinations are on the faculty of schools 
throughout the county, and district administrators are frequently related. 
Although many of the schools are in physically poor condition owing to 
age and lack of care, the community regularly turns dovm school bond 
ref crendums . 



Project Schools 

The Special Emphasis students were ho-jsed in a new building built 
by the Federal Government and leased to the county under a flood control 
relocation program. Well lit and ventilated space, a large gym, 
separate cafeteria, spacious office area and lounge, and a designated 
parking area were among its amenities. The building and grounds were 
well maintained by the custodial staff and several students employed 
by manpower funds. The newness of the facility notwithstanding, the 
student population exceeded the capacity of the school causing over- 
crowding and high student-teacher ratios. 

? The comparison school population occupied an old building, in 
obvious disrepair. Dark corridors, cracked tile floors, temperamental 
utility and heating systems, and closet-size office and lounge areas 
characterized the facility. As in the treatment school, the available 
space was inadequate to serve the students who were in classes averaging 
30 until the 1978-79 school year. At that time, the transfer of almost 
15Z of the student body to other district schools took the burden off 
this facility and greatly altered class size. 

The composition of the student body at both schools was stable. 
Change in school assignment was due to administrative decision rather 
than family mobility. Consequently, enrollment characteristics such 
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as ethnic attachment and SES remained fairly constant. These data are 
displayed on Table 4.31. 



TABLE A. 31 
ENROLLMENT CHARACTERISTICS 

Site: WEST VdGINIA 



School; 


Special Eaphaala 


CoB^ariaon 


Project Year: 


1977-78 


1978-79 


1977-78 


1978-79 


NtxDber of Students 


414 


436 


395 


342 


By Sex: 
Male 

Feaal^i 


53Z 

/ A 


53Z 


52Z 
48Z 


52X 
48Z 


By fiadal/Etfanlc Caceforletf: 
Black 
White 
filapaaic 

Other cr uacacegorized 


99X 
* 


lOOZ 
* 


lOOZ 


99Z 


Studenta Becelviag Free or 
Reduced-'Prlee Lrn^ 


74: 




54Z 


56Z 


Studenta for Whom E&gliah 
la a Second Language 




* 






Studenta Abaent More 
Than 25Z 


5X 


4Z 


7Z 


7Z 



Leaa than 

Rounding ^.atlaatea are responsible for colunn totals below or above lOOt. 



The staff at the treatment school experienced very little turn- 
over during the course of this study. However, 5 of the 13 teachers 
assignad to the comparison school in the fall of 1978 were new. As 
a group, the teachers at each school had similar levels of teaching 
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experience and education. Table 4.32 summarizes this data for school 
years 1977-78 and 1978-79. Both schools had the services of similar 
specialized staff; special education, speech, and physical education 
teachers . 



TABLE 4.32 
STAFF CHARACTERISTICS 

SltK WEST VIRBINIA 



School: 


Spacial Empbaala 


Conparlaon 


Project Tsar: 


1977-78 


1978-79 


1977-78 


1978-79 


Nu^ftr of TMchm 


13 


13 


13 




Toacbtrs with Graduata Dagraaa 


18% 


8Z 


20Z 


8Z 


Avcraga Taachar Exparianca 


12 yrs. 


15 yra. 


13 yrs. 


10 yrs. 


Avaraga Nuabar of Studanta/Claaa 


32 


34 


30 


26 



The teaching orientation of the teachers in the Special Emphasis 
schools, as illustrated in Table 4.33, was decidedly diagnostic-prescrip- 
tive compared to the comparison school teachers, which, as a group, 
tended to take a middle road between the diagnostic-prescriptive and 
whole-class approach. A majority of teachers in both schools tended 
to be structured rather than flexible in Leaching style, with the proj- 
ect school faculty reflecting a more structured style in 1978-79 than 
in the previous year. 

Although both schools were eligible for Title I services, no 
Title I staff served the treatment school during the project. The 
comparison school had one Title I teacher serving the remedial needs ■ 
of students throughout grades 1 through 6. Due to the scarcity 
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of space, the Title I teacher had no assigned room iu the building and 
most often worked in the hallway with small groups of children. Reading 
remediation was the focus of Title I during 1977-78, math during 1978-79. 
Four Title I aides were assigned to the comparison school: two assisted 
in kindergarten, one in the special education class, and one assisted 
teachers in grades 1 through 8 with reading. 



T/iBLE 4.33 
CLASSIFICATION OF TEACHING PRACTICES 

Sltft : WEST VIRCIKIA 



OrtftatAtlon 


1977-78 


1978-79 




Covarlscm 


SpsciAl 




Dl^nostlc AoproAch 


H I» 


H 




N X* 


M 


X* 


DUsDOstle* 


8 


67 


3 


33 


8 


62 


7 


58 


ScXaetlc ^ 


3 


25 


5 


56 


5 


38 


'5 


42 


^^Xft Class 


1 


8 


1 


U 


0 


• 0 


0 


0 


Structorad 


7 


58 


6 


66 


12 


69 


5 


42 


Eclftcdc ^ 


4 


33 


2 


22 


3 


23 


6 


50 


FlfadbU 


1 


8 


1 


12 


1 


8 


1 


8 



Basiid on tbm mmbmr of cImbtpob CMchars rftipondint. 



Tbm dttslgDAtlon **Eclftctlc** Indlcattt a tftftchlng orltntatlon which 
coabliiM alnanta ttom both approachat or stylaa. 



The State of West Virginia had established instructional time 
requirements for the teaching of reading and the language arts. A 
minimum of 100 minutes per day was required for students in grades 1 
through 6. The district-adopted basal reading series (American Book 
and Houghfon Mifflin) standardized the basic teachirg resources in all 
of the schools. Classroom reading was taught by following the basal 
series teacher's manual precisely. 
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A variety of hardware and softvrare was available in the treatment 
school. Movie and overhead projectors, tape recorders, record players, 
alternative basal series materials, and reading kits were- commonly used 
in classrooms at the treatment school. Movie projectors, record players, 
and a few alternative reading texts and kits w.^.re available at the com- 
parison school; their use was infrequent. 

The Special Eiiq)hasi8 Program 

The objectives of the West Virginia Special Emphasis Project were; 

• To effect a statistically significant improvement in 
reading achievement. 

• To correct 50% of the reading skill deficiencies as 
identified for each student each fall. 

Project Staff 

The director of West Virginia's Special Emphasis Project was 
also the principal of the treatment school. He was onsite full-time 
and personally directed all aspects of the project. Due to his close 
supervisory relationship with the teachers in his building, he was able 
to assert strong leadership over the entire educational program. 

Special Emphasis was staffed by one reading specialist, two 
reading teachers, three aides, and a part-time clerk. The reading 
specialist instructed students in grades 1 and 2, one reading teacher 
instructed students in grades 3 and 4, while the other instructed 
studenns in grades 5 and 6. Each reading specialist/ teacher had the 
assistance of an aide. There was no change in project staff over the 
course of this study • 

The Special Emphasis Treatment 

Each reading specialist/ teacher had her own classroom in which all 
Special Emphasis instruction was conducted. The rooms were arranged to 
accommodate multiple group activities taking place simultaneously. 
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Each first e.ad second grade class spent 50 minut^.^s daily with the 
reading specialist. Students were grouped according to skill needs and 
the specialist directed her teaching to areas of need. The aide conducted 
reinforcement activities and provided individual help under the direc- 
tion of the reading specialist. First and second graders received an 
additional 70 minutes of readiug instruction from their classroom teachers. 
Those students receiving Special Emphasis instruction in grades 3 through 
6 reported to one of the reading teachers daily. Third and fourth graders 
spent 40 minutes with a reading teacher, fifth and sixth graders spent 
30 minutes. These students also had 80 and 40 minutes of reading in- 
struction, respectively, by their classroom teachers. Whenever possible, 
the reading teacher worked with students as they were grouped for read- 
ing in Che regular classroom so as to cause minimal disruption to internal 
classroom scheduling. Aides assigned to the reading teachers conducted 
reinforcement activities and performed record-keeping tasks. 

The relationship between the reading specialists and classroom 
teachers appeared to be positive. A comparison between the questionnaire 
responses from these two respondent groups regarding their coordination 
showed that their perceptions were consistent with one another. For 
grades 1 and 2, the reading specialist and teachers planned and/or 
conferred on a weekly basis. For grades 3 through 6, this contact was 
less frequent. 



Special Emphasis participation data are presented on Table 4.34 
for years 1977-78 and 1978-79. 

Use of Materials 

The overall instructional design for this project was based upon 
the use of the Wisconsin Design tests. Individual student's reading 
skill strengths and weaknesses were assessed in the fall using these 
materials. Reading specialists then keyed their instruction to the 
test results and tracked each student's pro^^ress. The Wisconsin Design 
provided a highly structure^ management system covering all students 
in the treatment school at this sice. 



TABLE 4.34 
TREATMENT GROUP SIZE BY GRADE LEVEL^ 

S^^s WEST 7IRGIKTA 



* 

B«a«d on £xp«rl«mt«l School PrlndpaX Qu««tioim«ir«. 





Prolact Yaar 1977-78 

Total ; Sarvad By 
Earollamt Spaclal £nDh>.i« 


1 Pro1«ct 1978-79 

Total Z Sarvad By 
gr^rollmnt Spaclal EBm>i..4. 


GraiU I 
GrAdft 2 
Grada 3 


84 
61 
66 


ICO 
100 
62 


82 
82 
66 


100 
100 
62 


Grada 4 


69 


68 


64 


6: 


Grada 5 


68 


100 


66 


58 


Grada 6 


66 


94 


76 


38 



Reading skill instruction involved a variety of materials and 
hardware components. ZltB, tapes, films trips, work sheets, games, 
listening stations, and lab-type arrangements were in use. These 
included both teacher and commercially developed items. 

Inservice Traln- lny ^ Program 

The inservice training provided by the Special Emphasis Project 
was well received by teachers. They claimed that it was "somewhat" 
or "very helpful" in enabling them to carry out their classroom reading 
activities. The training was of a practical nature, e.g., the develop- 
ment of materials for reading Instruction. Reading specialists, class- 
room teachers, and aides all participated in Inservice activities con- 
ducted by an outside consultant. Teachers were awarded academic credit 
for participating in these sessions. 

S ummer Program 

In 1978, approximately 175 children attended the 4-week summer 
program at the West Virginia site. Reading specialises worked an addi- 
tional week, using the time to plan and prepare materials for the reading 



ERIC 



component of the program. Students were placed in class units organized 
by grade level. The program operated from 8:30 to 11:00 AM daily. Aside 
from the daily reading instruction, each student received a 15-minute 
exercise period and a 5-minute recess. Arts and crafts instruction was 
provided for 30 minutes, twice weekly. Students were transported to and 
from the program. 

The main objectives were: 

• To acquaint students with the world around them by 
exposing them to new experiences. 

• To retain already developed skills and foster devel- 
opment of additional skills. 

• To promote personal and professional growth by en- 
couraging creative input from classroom teachers. 

This program employed three reading specialists, each responsible 
for a particular group of students. Aides from the school year Special 
Emphasis program assisted reading specialists in handling the largest 
groups. Seven teachers assisted by five aides were likewise responsible 
for student groups. Each teacher conducted the IS-minute exercise period 
for her class. Approximately five parent volunteers assisted teachers 
on a daily basis. Parent volunteers were never assigned to their own 
child's class group. On Fridays, approximately 20 parent volunteers 
accompanied the children on field trips. All program volunteers were 
provided with daily bus transportation. 



Both teacher-made and commercially developed materials were used 
for instruction, in most respects , the summer program was a continuation 
of the regular school year program. This arrangement permitted teachers 
to follow up or areas cf pupil skill deficiency since their summer classes 
consisted almost entirely of r.heir former students. No formal assessment 
was employed to measure gains made by students during the summer session. 
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The summer program was managed in much the same manner as the regu- 
lar school program. The principal/project director performed routine 
super/isory, administrative, and coordinative functions; the reading 
program was executed by the. reading specialists. 

Notable features of this program were the integration of reading 
Into the arts and crafts classes and the improved student/ teacher ratio 
during the summer months. The broadening experiences of schedvled field 
trips was a much needed acti\'ity for children growing up in this area of 
the country where some families have little or no contact with outside 
areas. Class attendance at this site varied as the staggered vacation 
schedules of coal miners shifted. 

Attendance at the 1979 summer program was considerably l^jss than 
the previous year; 120 students enrolled. The instructionr:;. program, 
as in the past, was an extension of the regular school year program. 
However, there was a greater enQ)hasis on arts and crafts s^d physical 
education. Arts and cr /.t.-: instruction was provided for 45 minutes, 
twice weekly. A daily 15 -dnute physical education class was scheduled 
for aJ.l students. In . ,;4.tion to the arts and crafts teacher and physical 
education teacher, two reading teachers, five classroom teachers, and 
four aides were a-jsigned to the program. TWo parent volunteers accom- 
panied the students on Eriday swim outings. 

Program statistics are presented on Table 4.35 for 1978 and 1979. 

Compliance with Special Emphasis Guidelines 

The following Special Emphasis components were in compliance. A 
staff of three — one reading specialist and two reading teachers — provided 
Special Emphasis instruction. All first and second grade students were 
served by project staff. Third through sixth graders who had reading 
deficiencies received remedial attention. All students received more 
than the 40-minute minimum standard for instruction. A summer program 
was conducted each project year. Tnservice training was well attended 
and well received. An outside consultant conducted training sessions 
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TABLE 4.35 
SUMMER PROGRAM SUMMARY 



Slt«: WEST VIRGINIA 



PrQsrn Duration 
Hours p«r day 



giwiwt^y 1978 



4*0 
3.0 



4.0 
3.0 



InacmetloaaX hours In raading 
and raadlng-ralatad acdvitlas 
(hours par day) 



Total School ^EarolXasnt 



SujBar School EaroUaant 



Pareant of Total Enrol latrc 



Taachar/Adult-Studant Eatlo 



2.5 
414 

175 
42 
1:8 



2.0 
436 
120 
28 
1:9 



Staff 
Kaadlng Spadaliats 
Taachars 
Aldas 

Librarlaaa 
Gym/Art Taachar 
Voluntaers 



3 
7 
5 
0 
1 

5 paraati 



2 
5 
4 
0 
2 

2 parants, Friday* 



Voluataars not Indudad la coaputlng Taachar /Adult**StudBnt Ratio • 
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in which new materials and learning aids were developed and for which 
credit was awarded. No participation in program planning took place 
beyond the participation of the LEA and the school principal. The 
Wisconsin Design was adopted by this site as a system for diagnosing 
student skill deficiencies and tracking skill mastery. District- 
administered achievement tests monitored student progress. Activities 
to motivate interest in reading (which included project school staff, 
student, and parent participation) were not conducted. The schools 
selected for Special Emphasis participation were poorly matched in 
tenos of their physical environments and instructional aids. As 
specified in Section 3, intrasite problems and failure to comply with 
data requirements in a timely fashion posed difficulties for the evalua- 
tion effort. Table 4,36 presents the response rates for the various 
evaluation study Instruments, 



TABLE 4,36 

EVALUATION QUESTIOMAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 





lf77-7a 


i97ft-yf 








s^MiAi lapfciiti 






mmkmt or' 






lit 




t of 
fmlatloa 




I oC 
fWilatlow 




1 


100 


H/A 




1 


100 


H/A 




I 


100 


1 


100 


1 


100 


I 


100 


T»MlMr 


11 


as 


10 


77 


11 


100 


12 


92 


iMiiMJiMcUllar 


1 


100 


1 


100 




100 


H/A 




!«#4Uft» SamctMltmtm 


12 
2 


92 
67 


9 

nu 


69 


11 


100 
100 


12 


92 




H/A 




nu 




a/A 




_ m. 

M/A 






SI 


77 


0 


0 


S9 


H 


62 


9S 




lOS 


«•■• 


0 




97 


47 


129 


7t 




lU 




0 


0 


0 


0 




0 


Student laCacMtiM 
a»«ckiut 


3»7 


M 


39S 


100 


396 


100 


206 


60 



N/A • Not Appllcakla 




In summary, West Virginia complied with the major Special Emphasis 
project regulations, with two exceptions. The project failed to move 
beyojid the administrative levels In the area of program planning and 
failed to offer full support to the evaluation study requirements. 

Special Features 

The instructional program at this Special Emphasis site was based 
upon the diagnosis of student strengths and weaknesses through the use 
of the Wisconsin jDesign. The implementation of this system provided a 
firm basis for operationalizing a diagnostic-prescriptive approach to 
reading. 

Some parent involvement in the school reading program w«s evident 
at this site. One or two parents volunteered several hours on a weekly 
basis. They provided enrichment activities for individual or small 
groups of students. However, Special Emphasis, per se, did not attract 
parent participation except as chaperons for weekly off-campus outinga 
during the suimner program. 

Special Circumstances 

Special Emphasis at this site became a substitute program for 
Title I; Title I was removed from the treatment school in 1976 and 
was to be reinstated in 1979 at the conclusion of Special Emphasis. 

Data collection efforts were hampered by communication problems 



between the two schools involved in the project. The comparison school 
principal appeared ill-disposed toward the additional burden participa- 
tion placed upon his staff and toward the frequent testing to which 
students were subjected. According to the principal, his resentment 
was related to his original understanding that his school's commitment 
to the project was to be for 1 year only. GRC site visits and the 
semiannual SDRT admini3tr.ation seemed to take the comparison school prin- 
cipal by surprise. Consequent gaps in the site information and extreme 
delays in obtaining student demographic data caused delays in the data 
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processing and analysis of cross site data for this study. These problems 
persisted throughout the study and extended to the treatment school during 
the final year. Here, some teachers resented being excluded from planning 
and operational decisions and information regarding the testing and data 
collection schedule. 

Stimmary 

The strengths of the West Virginia project were the unifying 
character of the Wisconsin Design materials, which provided the 
diagnostic underpinning for the program; the central control vested 
in the school principal who served as project director; and the prac- 
tical nature of the iuservice training sessions, for which teachars 
received academic credit. The major drawback of Special Emphasis was 
the lack of comparability between the two schools. No particular 
weaknesses were evident in the project implementation, although the 
responsiveness of the project implementation, although the responsive- 
ness of the project administration to the evaluation requirements was 
at times problematic. (See Appendix G.) 

West Virginia's first objective, to effect statistically signifi- 
cant reading gains, was not investigated by the site itself. Impact 
measured by this study is presented in Section 5. No data were pro- 
vided by the site regarding its second objective, the correction of 
50% of reading skill deficiencies for each student as identified in the 
fall. 
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CALIFORNIA 



Background 

The California site is located in a predominantly blue-collar eco- 
nomic areas 15 miles from the center of a large bay area city. This is 
a stable area and the schools experience relatively little student 
turnover. The schools stiff er from budget cutbacks, part-time adminis- 
tration, a lack of equipment, limited space, and all other problems 
often inherent in au urban school system. 

California was the last Special Emphasis Proje^-t to be funded. 
Initiated in fall 1977, almost a year after the six other projects 
included in this report, it operated during the 1977-78 and 1978-79 
school years. The California sit.^ was added when two of the original 
Special Emphasis sites were not refunded. 

Project Schools . ^ 

The treatment ar ^ comparison schools in California serve similar 
student populations. The overwhelming majority of students are black, 
with a smaU number of white, Hispanic, and Asian students in the group. 
Table 4.37 provider a summary of enrollment data for school years 1977-78 
and 1978-79. While most student demographics remained constant over 
this time period, it should be noted that a dramatic change in the per- 
centage of students receiving: free or reduced-price lunch occurred. 
Whereas 56% of the students in the treatment school and 59% in the 
comparison school fell into this category in 1977-78, the percentages 
changed to 37% and 70%, respectively, in 1978-79. 

In 1978, average class size underwent an educationally significant 
change at both schools. At the project school, the number went from 28 
to 31 students, at the comparison from 27 to 31. Teachers at the proj- 
ect school were more experienced. However, the percentage of teachers 
with graduate degrees at the comparison school in 1978-79 was greater 
than at the project school. Data summarizing staff characteristics are 
found on Tible 4.38. 
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TABLE 4.37 
ENROLLMENT CHARACTERISTICS 

Slta: CALIFORNIA 



School: 


Special Emphasis 


Comparison 


Project Year: 


1977-78 


1978-79 


«>' / '78 


1 

1978-79 


Kinder of Students 


224 


244 


296 


276 


Sy Sex* 










Mele 


55X 


57X 


54Z 


52Z 


FeaeXe 


45Z 


43Z 


46Z 


48Z 


B7 RecUl/Ethnic OXegorles: 










Black 


70X 


74Z 


85Z 


86Z 


White 


19Z 


lOZ 


6Z 


2Z 


Hispanic 


91 


8Z 


4Z 


2Z 


Other or uncategorlsed 


21 


7Z 


5Z 


lOZ 


Students Becelvlng Free or 










Bsdueed-Prlee Lunch 


571 


37Z 


61Z 


70Z 


Students for Vhoa Englleh 
Is a Secotsd Utnguage 


2% 


2X 


5Z 


2Z 


Students Absent More 
Than 25Z 


4Z 


az 


5Z 


2Z 



Rounding eetlBatta k^re responsible for coluam totals below or above lOOZ. 



TABLE 4.38 
STAFF CHARACTERISTICS 

site: CALIFORNIA 



School: 


Special Eaphasls 




Project Tear: 


1977-78 


1978-79 


1977-78 


1978-79 


Nuiber of Teachers 


8 


8 


11 


9 


Teachers vlth Graduate legrees 


50Z 


SOZ 


44Z 


83Z 


Averege Teacher ^ixperlence 


18 yrs. 


17 yrs. 


13 yrs. 


14 yrs. 


Average Nuaber of Studente /Class 


28 


31 


27 


il 
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The two schools had similar traditional buildings; classrooms 
were arranged on long corridors, which were bleak and dark. At the 
comparison school, three classes were housed in portable buildings. 

Neither school had a librari^;n; classroom teachers accepted the 
responsibility on a rotating basis. 

The Classification of Teaching Practices (Table 4.39) points up 
a marked difference between the staffs of the two schools in 1977-78. 
Special Emphasis school staff tended to be more structured than com- 
parison school teachers. Data missing from the comparison school pre- 
clude analysis for 1978-79. 



TABLE 4.J9 
CLASSIFICATION OF TE.^CHING PRACTICES 

SlC« 1 CALIPORHIA 





1977-78 


197a 


k79 


Tg aching 




Conrtarlson 


Sp«ClAl 

Eaphaslfl 




DiatDostie ADProAch 


It X* 


K 


X* 


N 




N X* 


DlAtBOscle' 


3 


43 


5 


45 


6 


86 


DATA 


Beltetle ^ 


4 


57 


5 


4f 


1 


14 


MISSING 




0 


0 


1 


10 


0 


0 




















Scxuctimd 


5 


71 


4 


36 


4 


57 


DATA 


Eelsetic ^ 


2 


29 


6 


55 


3 


43 


MISSING 




0 


0 


1 


8 


0 


0 





Bu«d ou thm auib«r of clAMroom eaach«rs rupondlng. 



TtM dM^Si^cioa **^l«ctlc" ludlcACM a caachlng orlcacacion which 
coabiaias al«Macs froa boch approachaa or styles. 
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The basic reading programs in treatment and comparison schools 
were similar. Teachers used the Lippincott, and Holt, Rinehart, Winston 
basal reading series proceeding from one level to the next as described 
by the texts' authors. In 1976, the Lippincott skill mastery record 
keeping system was introduced which was used for all students in both 
schools. This management system tracked student progress and was a 
tool which directed teacher. instruction. 

The treatment and comparison schools were eligible for and received 
Title I services. A Title I reading specialist was assigned to each 
building. Both specialists conducted similar programs. Title I students 
spent 2 hours each week away from their regular classes for small group 
instruction in reading. There was a disparity in the number of Title I 
aides assigned to each school. Eleven Title I aides served the treat- 
ment school, one served the comparison school. 

The Special Emphasis Program 

The particular objectives of the California program as reported 
by the project director were: 

• To provide reading instruction for all students in grades 
1 and 2 and to those students in grades 3 through 6 who 
are reading below grade level. 

• To familiarize the community (especially parents) with 
the Special Emphasis Program. 

« To encourage parent participation in the project and to 
provide them with techniques to use at home to improve 
their children's reading skills. 

• To improve reading instruction competencies of classroom 
teachers. 

Project Staff 

The Special Emphasis Project was headed by the reading supervisor 
of both the treatment and comparison schools. In addition to serving 
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project director, she was responsible for supervising the reading 
programs and Title I programs at the two schools. All these responsi- 
bilities were administered from her office located at the project school. 
A full-time secretary provided clerical and administrative assistance 
for the project director. 

Two reading specialists and one reading teacher were employed by 
the Special Emphasis Project. Reading specialists were responsible for 
the selection of objectives for individual students, instruction, test- 
ing and assessment, and training aides. In collaboration with the 
project director, they planned and conducted inservice training and 
participated in making decisions regarding the basic approach to read- 
ing instruction. 

One full-time aide was assigned to Special Emphasis. In assisting 
the reading specialists, she prepared materials and conducted instructional 
follow-up activities with students. 

The Special Emphasis Treatiaent 

Reading specialists worked in a classroom/lab which was designated 
for Special Emphasis instruction and periodically in the regular class- 
room. First and second grade students received 1 hour per day of read- 
ing instruction by reading specialists. Planning between the specialists 
and? classroom teachers took place on a weekly basis, and the reading 
specialists and classroom teachers worked together developing materials 
to aid student learning. 

Special Emphasis staff serving grades 3 through 6 worked with 
small groups of students in the specialist's classroom. Students read- 
ing below grade level reported to the specialist's room daily for a 
30-minute period. Regular classroom teachers and specialists communi- 
cated weekly to exchange plans and note progress. 

Table 4.40 indicates the percentage of students enrolled in each 
grade who were served by Special Emphasis. 
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TABLE 4.40 
TREATMENT GROUP SIZE BY GRADE LEVEL* 

Sice: CALIFOKMIA 





'^oZMl X scrvad By 
fe^oiiawt SpaclAl Eaphuls 


?ro1«ct Yamr 1978-79 

TotAl X SATVttd By 
EnroUaanc SmcI&I EmDhAaia 


Qrmdm 1 


39 


36 


36 


100 


Gradtt 2 


39 


49 


43 


100 


Grmdm 3 


32 


41 


42 


31 


Grada 4 


30 


40 


42 


43 


Gradft 5 


33 


67 


41 


39 


Gradft 6 


30 


« 1 


40 


45 



* 

BM«d on Exp«riJMatAl Schpol Fir.lncipal QuMtloui^r*. 



U se of Materials 

The primary focus of this Special Emphasis Program was the under- 
achiever in reading. In serving these students, remedial instruction 
for students reading below grade level and corrective instructiop for 
students deficient In specific skills were provided. The instructional 
resources and approaches employed were: audiovisual kits and programmed 
materials, games, workbooks, silent reading periods, learning centers, 
and? interest centers. Specialists and aides geared their instruction 
to small groups of students. 



Inservlce Training Program 

The inservlce training program was designed by the project direc- 
tor and one of the reading specialists to meet specified project needs. 
The inservlce training was conducted by the project director and the 
reading specialist for classroom teachers and aides. The teachers and 
aides received instruction in curriculum development, diagnostic- 
prescriptive teaching, individualized instruction, reading in the con- 
tent area, preparation of support materials, and reading assessment. 
Of the teachers and aides involved in the inservlce training, 83% found 
it to be helpful. 



Summer Program 

The passing of Proposition 13 resulted in the delayed start-up of 
the California site's summer program in 1978. A 15-day summer program 
for approximately 40 children was held. The 3-hour ciaso day was divided 
into two 75-minute instructional periods—one for s true cured reading ac- 
tivities, the other for interdisciplinary language arts activities. A 
30-minute break between periods was provided. 

Primary objectives of the program w^re: 

• To asse^^s children's reading needs. 

• To increase, through counseling sessions, student 
awareness of individual strengths and weaknesses 
and motivate students to assume responsibility for 
improvement in weak areas. 

• To inform parents of teaching techniques a; d encourage 
them to become more involved in their children's r^al 
ing. 

The program was staffed by a project director, three reading spe- 
cialists, and two aides who assisted in the structured reading sessions. 
Two volunteers worked as a tutor and as a supervisor during the 30-minute 
recess . 

Since emphasis was placed on multisensory activities such as oral 
language and integrated language arts, materials were locally developed 
by teachers and pupils. As a supplement, teachers made use of materials 
produced by Lippincott (Superbooks) and Holt, Rinehart, Winston. 

The project director and reading specialists informally shared 
their ideas and concerns on a daily basis. They attempted to key the 
summer pro.gram with the regular school-year program through the use of 
the school's basal series management system. 
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In 1979, the California summer program had the same format and 



chedules as in 1978. Program objectives were modified to include: 



Continuation of the school-year program. 

Maintaining student reading skills developed during the 
school year. 

Increasing student reading vocabulary and compr-;hension 
skills. 



The summer staff in 1979 included three reading specialists, one full- 
time aide, one half-time aide, and two adults who served as volunteer 
aides . 

A Title I summer reading clinic operated simultaneously with the 
SpQci Emphasis summer program. Students enrolled in the Special 
Emphasis program had the option of joining the Title I clinic after 
their program's conclusion. Students from the comparison school partici- 
pated in the Title I summer reading program, contrary to Special Emphasis 
regulations. 

A summary of Special Emphasis summer program statistics is found 
in Table 4.41. 

Coiig>liance with Special Enphasis Guidelines 

A staff of two reading specialists and one reading teacher served 
the Special Emphasis school. During project year 1977-78, this site 
did not serve all students in grades 1 and 2. The minimum instructional 
tine in reading was exceeded. A summer program was operated in 1978 
and 1979 — the 2 years in which this site was funded, although students 
from the con5)arison school were included in 1979. Teachers indicated 
that inservice training was available. Participation in program 
planning did not extend beyond the staff. Activities to stimulate 
interest in reading which included staff, student, and parent participa- 
tion were not developed. A skill mastery record keeping system which 
also included diagnostic testing was instituted. The student body at 
each school was well matched until a change in student SES occurred 
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TABLE 4.41 
SUMMER PROGRAM SUMMARY 



Sit* : CALITORNIA 



r 1975 



?rosra Duration 
Hoars p«r day 



XattrtietloaAl hours in rssdlng 
ttd rsadlag-roUtod actlvlclM 
(boim p«r daj) 



total School Enroll^Mttt 

Sumn School EaroUatnt 

Parca&c of total EaroUmat 

taac2iar/A4ult*Studaat Batlo 

Staff 

Baadlag Spadaliata 
taachara 



Librarians 
Crs/Art Taachar 
Volmtasrs^ 



3.0 
3.0 



2.5 
224 
40 
18 

1;8 



3 
0 
2 
0 
0 
2 



Suas^r 1979 



3.0 
3.0 



2.5 
244 
68 
28 
1:15 



3 

0 

1.5 
0 
0 
2 



VoXimtaars not lacludad In eoaputlng Taachar/Adulc*Scud«nt Eatlo. 
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in project year 1978-79. Disparate levels in service were also noted to 

compromise the integrity of treatment and conrparison school mauchability . 

Table 4.42 indicates the response rates for the evaluation study instru- 
ments at this site. 



TABLE 4.42 

EVALUATION QUESTIONNAIRE RESPONSE RATES 
(BY RESPONDENT GROUP) 





1977-78 


197B-79 






^hirato 


Cni^iiirliion 


Sp«cUl Fj^thmilii 


Ccm|iarlami 




Nnahcr of 


Z of 
fopttljtion 


Konpondoats 


X of 
Population 


Koapondanta 


Population 


|t«»iicr of 
Ren|iondtnta 


X of 
Population 


Troltc'S Diractov 


1 


100 


H/A 




0 


0 


! 

N/A 




frlnclMl 


0 


0 


1 


100 


1 


100 


1 


100 


Ttachvr 


A 


75 


9 


82 


7 


nil 


s 


55 


KMdinK S»«cLallst 


« 


100 


0 


0 


3 


75 


0 


0 


Climiiirtcation of 
TVMcltinK rriictlc««t 

R«a<lijiK Sp«cl« lists 


7 
0 


M 

0 


n 

0 


100 
0 


7 
0 


nn 

0 


1 

0 


11 
0 


Ubrarlai^ 


R/A 




R/A 




H/A 




N/A 










S2 


100 


0 


0 


24 


47 




91 


96 


US 




73 


39 


HI 


32 


rartnt 


IM 




1S9 




0 


0 


A4 




StuHcnt Inrnraotion 


201 


91 


2V0 


99 


a: i 


117 


110 


40 



R/A • Hot Aptllcabla 



Special Eii5)hasis, as it was envisioned in the project regulations, 
was never fully implemented at the California site. 

Special Features 

In fall 1977, the California site adopted the Lippincott management 
system to track mrstery of reading skills. This system served as a tool 
to identify students needs and to guide instruction. It was also the basis 
of interaction between specialists and classroom teachers. Teachers plotted 
• each child's skill attainment and, in conjtmction with specialists, developed 
a plan for meeting each child's needs. 
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The site reported that Special Emphasis funds provided for the 
part-time employment of a 3chool psychologist. It was felt that "the 
needs of the whole child" could best be met by such professional services. 
However, according to USO^'s Contracts Office, funds for a psychologist 
were not approved. 

Special Circumstances 

Over the 2-year course of this program, it was difficult for the 
evaluation team and the USOE program officer to determine precisely what 
constituted Special Emphasis at the California site. The inability of 
project staff to distinguish between Special Emphasis and Title I offerings 
evinced a lack of understanding or agreement with the Special Emphasis 
guid'^lines. It appeared to the study team that the information regarding 
project implementation was continually changing. Evaluation question- 
naires provided coatradictory information and, on more than one occasion, 
they were returned blank or only partially complete. 

Other circumstances influencing the study at this, site included 
the following: 

• A change in program design between year 1 and 2. Strictly 
a pull-out program during year 1, Special Emphasis added 
an in-class component during year 2. 

• The project director was a significant presence in the 
treatment school. Her commitment of time, materials, 
encouragement, and direct guidance contributed to strong 
rivalry between the treatment and comparison schools. 

• The passage of Proposition 13 in California had a de- 
monaizing effect on the teaching staff. Staff cutbacks 

did occur, and the average class size increased significantly. 
Proposition 13 caused delay in the scheduled summer program 
in 1978. 

© Special Emphasis did not serve all those students it was 
intended to serve, 
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The comparison school teachers were not fully receptive to the 
evaluation team. Some of the problems seemed to result from the fact 
that both the treatment and comparison schools were administered by 
the same individuals. The principal and reading supervisor senred 
both. By admission, these individuals favored the treatment school 
and spent more time there , thus appearing to leave the comparison school 
without strong leadership. 



S'lmmary 

The project director at the California site had multiple roles 
±7X both the experimental and control schools. In addition to her role 
in Special Emphasis, she was the reading supervisor and Title I program 
director for both schools. Title I and Special Emphasis appeared to 
be merged; distinction between the two programs was difficult, if not 
impossible, to detect. According to the data supplied by the California 
sits. Special Em^, basis was not serving all first and second graders— 
at leasr in 1977-78. Significant features of Special Emphasis appeared 
to be the additional staff and the encouragement and support provided 
by the project director. 

The first objective set by the California site, which was also a 
program regulation, was not fully operationalized during the 1977-78 
school year. All first and second graders were not served by Special 
Emphasis Project staff. The second and third objectives were purported 
to have been accomplished. However, the study team found no evidence 
of parent awareness efforts or changes in parent participation nor did 
staff questionnaire responses substantiate this claim. With respect 
to the fourth objective, improving reading instruction competencies, 
GRC reviewed questionnaire data for indications of change and reports 
on this in Section 5. 
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CROSS SITE ANALYSIS 

'ilie preceding profiles of the seven Special Emphasis projects 
highlighted each site's distinctive features and described how Spacial 
Emphasis was implemented and integrated into the regular school programs, 
Tae comparability and variability among the seven project sites will be 
discussed in the following subsections. This review of site and pro- 
gram characteristics was conducted to determine the comparability be- 
tween treatment and ccmpariscn schools, to examine the diversity and 
representativeness of the projects nationwide, and to identify the 
potential influence of these characteristics upon project outcomes. 
The aspects of Special Emphasis projects which will be summarized in 
the following subsections are: 

• Participant Characteristics 

• Staff Charact«»iistics 

• Special Emphasis Implementation 

• Project Administration 

Parf;icipant Characteristics 

Data for project year 1977-78 showed that, across all sites, males 
comprised 52% of the Special Emphasis students and 50% of the students 
in the comparison schools. In 1978-79, the percentages reflected a 
similar mix. 

With respect to racial/ethnic composition, blacks comprised 45%, 
Hlspanlcs 11%, and whites 43% of the Special Emphasis schools. The 
comparison school counterparts were 43% black, 9% Hispanic, and 47% 
white. West Virginia had an almost all white population, Michigan 
almost all black, and Louisiana approximately equal numbers of white 
and black students. Differences between schools were found in Tennessee 
where the Special Emphasis school was 26-29% white vs. 47-48% of the 
comparison school. In California, the comparison school had approxi- 
mately 10% more minority enrollment. Otherwise, Special Emphasis 
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and comparison schools within sites were comparable with respect to 
racial/ethnic composition. 

Because studies of educational interventions have shown a close 
relationship between the SES of students and their academic performance, 
GRC documented the incidence of students receiving free or reduced-price 
lunch as an index of SES level. It i^hould be noted that the voluntary 
enrollment in subsidized food programri and the varying vigor of recruit- 
ment efforts limit the reliability of this measure. However, data for 
project year 1977-79 showed low-SIiS students ranged from 39% in Texas 
to 81% in Michigan and Tennessee.. SES compositica within sites was 
balanced in Michigan, Ohio, and Texas. In Louisiana, Tennessee, and 
West Virginia, the Special EmphaJis schools had greater percentages 
of low-SES students; in California:, the comparison school had a greater 
percentage of low-SE5v students. 

Another factor believed to influence treatment outcomes was 
student mobility and absenteeism. Students missing 25% or more of 
the school year ranged from 1% in Louisiana to 11% in Ohio. GRC found 
that the combined factors of absenteeism and student transfers accounted 
for significant sample attrition. Only in Ohio was there a difference 
in degree of absenteeism between the Special Emphasis (5%) and the 
comparison school (11%) . One measure of the inflxience which mobility 
and absenteeism had on the data is provided in Appendix B where the 
differences between students with the pre- or postte3t only are 
Summarized in the table««. 

Another characteristic deemed impottant was the extent to whi'ch 
the participant population included students with learning disabilities. 
Students officially recognized as having learning disabilities/problems 
were excluded from the impact analysis.^ Appendix A contains tables 



'A number of factors influenced the official designation of students 
with learning disabilities. Family objections, community mores, and 
the evailability of special services and funds are linked to the iden- 
tification of these students. Consequently, the numbers reported by 
each site of students removed from the imoact analysis may not reflect 
the actual incidence of students who had learning problems. 
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which illustrate the numbers of such students eliminated from this 
study. The highest numbers of students with learning disabilities 
were reported in Louisiana and Texas. Elimination of such students 
from the study had the effect that (1) students not capable of functioning 
on a reading test were not tested, and (2) if one school were operating 
under broader identification criteria, that school may have eliminated 
from the study a greater proportion of low achieving students than did 
the other schools. Differences in percentages of students in the 
experimental and comparison schools identified as having learning 
disabilities were noted in Louisiana, Tennessee, and Texas (in 1978-79). 

Staff Characteristics 

Within the context of this study, school staff members with the 
greatest influence over the performance of students were thought to be the 
regular classroom teacher and the reading specialist. Each staff member 
was questioned regarding his/her academic and professioual experience 
as well as his/her teaching practices. 

Classroom Teachers 

The majority of class ro ai teachers had over 6 years of teaching 
experience; for project year 1977-78, 67% of the teachers at the treat- 
meat school and 61% at thi comparison school had 6 or more years of 
e^xperience. The picture changed somewhat in project year 1978-79 when 
65% of the teachers at the treatment schools and 56% at the comparison 
schools h^d more than 6 years of teaching o.^perience. Overall, teachers 
at the treatment schools had more experience thau their counterparts. 
The most experienced teachers were found in California, Ohio, Louisiana, 
and West Virginia. It should be pointed out that the more experienced 
teachers were also less recently trained and may, therefore, have had 
less exposure to recently developed technology of teaching reading. 
In 1979, 39% of the teachers at the Special Emphasis schools had 
graduate degrees compared to 31% at the comparison schools. A majority 
of the teachers at both schools in the Michigan and California sites 
had graduate degrees. 
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To determine the general orientation of teachers with respect to 
teaching practices, GRC surveyed the teachers to determine whether they 
were inclined to be "diagnostic-prescriptive'' in their approach, or 
were inclined to take a "whole-class" approach. Similarly, GRC sought 
to find out whether teaching methods tended to be "structured" or "flex- 
ible/*^ 



In most instances, the general orientation of teachers in the 
treatment and con?)arison schools was similar. Few teachers used a 
whole-class approach and few teachers could be classified as flexible. 
In 1979, exceptions to this pattern existed in Louisiana and Texas 
where none of the Special Emphasis teachers followed a whole-class 
approach vs. 27% and 18% in the respective comparison schools. 

Teaching materials used across sites and within sites were generally 
similar. The basal reading series was the mainstay of every institutional 
program. In conjunction with the basal text, skill activities—both pub- 
lished and teacher developed—were major resources. Table 4.43 summarizes 
the materials used in the respective sites. It is evident from Table 4.43 
that treatment and comparison schools in each site used the same matv^r- 
ials and management systems. Management systems were more commonly used 
on the first and second grade level than at grades 3 through 6. With one 
exception (California), the availability of equipment and materials 
for extending and enhancing the reading program was high. Teachers 
and school administrators credited Special Emphasis with having increased 
the variety and amount of hardware and software In general use. Utiliza- 
tion of these items varied from site to site. In Ohio, they played a 
major role in the reading prognim; in Louisiana, Tennessee, Texa«, and 
West Virginia, they received moderate use; in Michigan, and California, 
they played a minor role. 



"^Definitions 



of these terms are found in the Glossary, Appendix H. 
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TABLE 4.43 
MAJOR READING RESOURCES UTILIZED 





Basal 


Management 
System 






Grades 


Grades 




Sites 


1- 


2 3-6 


1-2 


3-6 


Louisiana: 


Special Emphasis 


H 


H 


PT,H 


PT,K 




Comparison 


H 


H 


PT^H 


PT.H 


Michigan: 


Special-. Emphasis 


C 


C,H 


D,X 






Comparison 


C 


C.H 


D,X 




Ohio: 


Special Emphasis 


H 


H,B 


X 


X 




Comparison 


H 


H.B 


X 


X 


Tennessee: 


Special Emphasis 


H,D 


H,D 


H,D 


- H 




Comparison 


R.D 


H.D 


H,D 


H 


Texas: 


Special Emphasis 


H 


H 


X 


X 




Comparison 


H 


H 


X 


X 


West Virginia: 


Special Emphasis 


H, A 


H,A 


WD,H 


WD,H 




Compa'j ison 


H,C 


H 


H 


H 


Calif oml?.: 


Special Emphasis 


L 


L,C 


L 


L 




Comparison 


L 


L.C 


L 


L 



KEY: A » American Book 

B « Har court Brace 

C « One or more of the following: Bank Street Reader; Holt, Rinehart, Winston 

D « DISTAR 

H « Houghton Mifflin 

L « Lippincott 

PT « Precision Teaching 

WD « Wisconsin Design 

X « School/ district-developed 
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Reading Specialists — Characteristics and Utilization 

With the exception of Ohio, reading specialists were veteran teachers. 
However, vTiost had limited experience in the role of reading specialists. 
Special Emphasis, together with increasingly stringent state requirements 
for reading instruction, may have been responsible for many of these 
teachers being en?)loyed as reading specialists. Only West ^^Irglnia 
was there an indication that the staff had in-depth experience as reading 
specialists. Table 4.44 summarizes the qualifications of the reading 
specialists from the seven sites. 

Special Emphasis reading specialists provided instruction in 
different settings across the sites and within each site: 

• In Louisiana, Special Emphasis instruction was provided for 
all students grades 1 through 6 in the specialist's class- 
room. 

• Tennessee also offered instruction by reading specialists 
to all students, but placed the specialists in the regular 
classroom with the classroom teacher. Additional remedial 
attention was provided in the specialist's classroom to 
students in need of special help. 

• Michigan served all first and second graders in their 
regular classrooms and those third through fifth/sixth 
graders having reading problems in a reading room. 

• Texas followed this same format. 

• Reading specialists in Ohio, West Virginia, and California 
taught in their own classrooms. In California, students 
came to the specialists in small groups; in Ohio and West 
Virginia, students in grades 3 through 6 received instruction 
in groups numbering 9 or more, with first and second graders 
served as class units in the specialist's classroom. 

Table 4.45 summarizes the ways in which reading specialists were 
deployed across all projects. In four of tike sites, specialists worked 




TABLE l^M 
PlIFICATIONS OF READING SPECIALISTS 







Itttt 

Experler 

1AH ID 


— ■ 

teaching 
ice (van) 
1978-79 


■ f" — 




U 
Gradual 
1977-78 


ith 

e Degree 


I Heetint US 


OE Guidelines as! 




Specii 
1J7?"78 


iliata* 
1978-79 


Years u 

Special] 
1977-78 


1 Reading 
at (Qean) 
1978-79 


Reading 
Teacher 


Reading 
Specialist 


Reading 
Teacher 


Reading 
Specialist 


1 nttlfllnn^ 




5 


12 


16 




5 


60 


1978-7S 

75 


77-78 

0 
u 


iy? 

inn 


77-78 
U 


78-79 

4 Aft 

100 


KirhlfiAn 


6 


- 7 


0 

0 


9 


3 


k 


100 


lOO 


50 


iO 


0 


10(1 


Ohio 






3 




2 




0 




100 


0 


V 

• 


m 


lenneasee 




_ 6 


6 


9 _ 




6_ 


_10Q 


.100 


0 


100 


0 


100 


TeiM 




^ 1 


/ 




2 




_100 




17 


83 


0 


100 


Heat Virginia 




. 3 


20 


„„ 21 


8 


10 


33 


33 


66 


.13 


66 


33 


California 




,. \ 


15 


12 


2 


3 


100 




33 


66 


33 


66 


Ul Sites 


33 


_32 


10 












38 


62 


17 


83 



Includes Title I and district reading specialists. 
Mo data is available froi Ohio for project year 1978-79. 
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TABLE 4.45 

DEPLOYMENT OF SPECIAL EMPHASIS READING SPECIALISTS 



Site 


Special Emphasis Instruction 


it 

Pull-Out 


Within Classroom 


wnoxe 
Class Groups 
(Grades) 


Individual/ 
Small Group 
f Grades) 


(Grades) 


Louisiana 


1.2,3,4,5.6 






Michigan 




3.4,5/6 


1.2 


Ohio 




1,2,3,4.5.6 




Tennessee 




1.2,3,4.5.6 


1.2.3.4.5.6 


Texas 




3.4.5 


1,2 


West Virginia 


1,2 


3.4,5.6 




California 




1,2,3,4,5,6 


1^2^ 



"Pull'-out" refers to the practice of removing students from the 
rt-gular classroom setting for a period to receive program treatment. 

Occasionally deployed In this manner. 
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worked in the regular classroom with the classroom teacher— unUke most 
compensatory or intervention programs which remove (or "pull-out") students 
from the regular classrooms for special instruction. 

While the settings and groupings iu which reading specialists 
worked varied, instructional materials utilized by these reading special- 
ists tended to follow a general pattern. Specialists conducting the 
basic reading instruction relied on a basal reading series as did the 
regular classroom teachers. Specialists providing remedial instruction 
relied upon teacher developed as well as commercial skill activities. 
While instructional kits were seldom mentioned as a resource, the 
study team saw such materials in use at most sites. 

Special Emphasis Implementation 

Before attempting to assess the effect of Special Ei!5)hasls,. it is 
first necessary to assess the implementation of the respective projects 
in light of Congressional and USOE specifications. Briefly, the major 
requirements were: 

Employment of reading specialists or reading teachers. 

Special Emphasis instruction for all first and second 
grade students. 

Special Emphasis instruction for all third through sixth 
graders reading 1 or more years below grade level. 

A minimum of 40 minutes of reading instruction per day. 

An intensive summer reading program. 

Preservice and inservice training for Special Emphasis 
staff. 

Broad-based participation in program planning. 
Establishment of reading skill mastery record keeping system. 
^ Comparable treatment and comparison schools. 
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The data compiled on each of the seven Special Emphasis projects were 
reviewed and compared to these requirements.^ Table 4.46 presents the 
results of this review. A score of "1" in each cell of the table indi- 
cates that the specified criteria had been implemented. A "2" indicates 
implementation beyond minimum standards , and a "0" indicates lack of 
compliance. Thus, a Special Emphasis project meeting all USOE guidelines 
would have an overall minimum total of 9, and no "O" cells on Table 4.46. 
Individual projects may have a total score exceeding 9, and not be in 
compliance . 



A brief summary of the implementation of each of these components 
follows .- 



Reading Specialists 

All Special Emphasis projects employed reading specialists, or 
reading teachers, in conformity with USOE regulations. In addition to 
Special Emphasis reading specialists at the treatment school, all sites 
except West Virginia and Ohio had other reading specialists on their 
staffs which were funded by Title I, ESAA, or the school district. 

Special Emphasis Instruction 

Special Emphasis instruction was provided to all first and second 
grade students in each site except in Ohio and California. (No reasons 
for^lack of compliance were given.) Special Emphasis instruction for 
students grades 3 through 6 who were 1 or more years below level was 
apparently provided in all sites except Michigan, where, by agreement 
with USOE the lowest achieving 20% of studeuts grades 3 through 6 were 
served. A3 noted, there were no across-site, uniform measures or 



In addition, project guidelines required sites to: provide diagnostic 
testing to determine skill deficiencies, conduct periodic testing to 
measure achievement, and establish a comprehensive reading program. 
Each site met these requirements; however, because the regulations 
specify that these features be implemented "to the extent possible," 
no cross-site comparisons have been made. Similarly, compliance with 
other requirements which were part of the contract agreements (e.g., 
no vacation school for comparison school students) are noted in the 
site-specific descriptions, but are not included in the cross-site 
analysis. 

^These terms are defined in the Glossary* Appendix^. 
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TABLE 4.46 

IMPLEMEMIO.N OF SPECIAL EMPHASIS REQUIREMENTS 



1. Employment of reading sp e cialists/ teachpra 



2. Treatmen t of all first and second f^raHpra 



LA 



3. Treatment of all third through sixth graders 
one or more years below grade level 



4« Minimum o f 40 minutes of readini^ instmrUnn 
5. Provision of summer readlnR program 



6. Provision of prPBPrvir e/lnservlce trains n p> 



7. Broad-based ^m^raf, p lanning particip aMnn 

8. Establishment of skill mastery record 
keeping system 



h Comparab le treatment and comparison schnnla 



rOTAL 



2 



1 



14 



MI 



0 



0 



OH 



TN 




16 



TX 



14 



WV 



(BY: 2 « Highly developed or implemented 
1 = Met the minimum requirements 
0 =» Not implemented, out of compliance 



11 



CA 



8 
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procedures for selecting students grades 3 through 6 for participation 
in Special Emphasis, nor for tracking them following participation. 

The 40-minutes per day required minimum of reading instruction 
was met by all but the Michigan site. In this regard, it should be 
noted that the Special Emphasis regulations did not specify how much 
reading instruction was to be provided by the reading specialist — only 
that each student receive a minimum of 40 minutes per day and 20 to 30 
minutes of teacher-directed instruction. Table 4.47 provides a summary 
of the amount of time devoted to Special Emphasis and other reading 
instruction in the respective schools. 

Many of the treatment schools provided varying amounts of reading 
instruction at individual grade levels. As Table 4.47 indicates, in 
some sites reading was integrated into a Language Arts time block for 
which the schools were unable to specify a precise amount of time for 
each of the subjects included during the period. 

Summer Reading Program 

All sites designed and implemented summer schools which provided 
intensive reading instruction along with complementary multi-activity 
experiences. While the Michigan and California program operated under 
restricted circumstances during one of the summers, the study team 
was impressed with the amount of creativity and enthusiasm engendered 
by project staff in each of the projects. In 1978, actendance at the 
summer programs ranged from 18% in California to 67% in Tennessee. 
Louisiana and Tennessee were the only sites to attract more thaii half 
of the total school enrollment. The average participation rate across 
all sites was 37.5% in 1978 and 35.6% in 1979. Some of the more 
interesting and engaging activities provided by the projects were: 

• Field trips to airports, bakeries, zoos, and a variety 
, of business-industry-recreation settings which provided 
children with experiences which were used in language- 
experience exercises related to reading instruction. 
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TA3LE 4.47 
INTENSITY OF READING INSTRUCTION 







Site 


Grade 


Special Gmphasls 


CULdl 


Dcnooi 

Regular 
Reading Instruction 
(Minutes) 


C( 

Grade 


jnkoarison Schonl 
(Minutes) 


iiOuisiana 


1 
2 
3 

4-6 


90 
60 
60 
60 


1 

2 

0 

J 


30 
30 

on 


1 

2 
3 

4-6 


90 
90 
90 
75 


Michigan 

■ ■ 


1-2 
3-5 


70 
30* 


3-5 


30 


1-2 

3-5 


t 

80*'' 


Ohio 


1-2 
3-6 


40* 
30* 


1 
2 

3-6 


120 
90 
60 


1-2 
3-6 


80 
60 


Tennessee 


1 

2 
3 

4-6 


45,30* 
45,35* 
45,35* 
45,35* 


1-2 
3 
4 

q 
J 

6 


45 
45 
60 
45 
60 


1-6 


60 


Texas 


1-2 
3-5 


80 
30* 


3-5 


60 


1-2 
3 

4-5 


90 ■■ 
75 

60 


fest Virginia 


1-2 
3-4 
5-6 


50 

40* 

30* 


1-2 
3-4 
5-6 


70 

8o: 

40+ 


1-2 

3 

4-6 


150j 
150! 
120^ 


California 


1-2 
3-6 


60 
30* 


3 

4-6 


60 
50 


1-2 
3-6 


50 
50 



Selected students. 



other Language Arts such as spelling, grammar, and writing. 
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An inexpensive book distribution on an unspecified day 
each week— designttd to stimulate attendance at summer 
school and the students' interest in book reading. 

Gym and library activities which were integrated into 
the reading curriculum by presenting learning activities 
dealing with eye-hand coordination; following directions; 
worlds of fantasy and creativity; and the relationships 
between music, dance, song, and literature. 



Preservlce and Inservice Training 

Preservice training for teacher and clerical aides and inservice 
training for project staff and classroom teachers were held in all the 
sites. Participation was voluntary except in Tennessee, Texas, and 
California. Programs were designed and conducted by project staff 
except in West Virginia. Three projects, Tennessee, Texas, and West 
Virginia, utilized the services of an outside consultant; three of 
the projects offered graduate credits for participation (Louisiana and 
Michigan in 1977, and West Virginia in 1978 and 1979). As a result of 
participation in these sessions, some teachers continued graduate 
course work and received graduate degrees. All sites had courses 
vjhich focused on diagnostic-prescriptive approaches to teaching read- 
ing and several involved the development of mr^terials for teaching 
reading . 



Broad-Based Planning 

As shown on Table 4.46, .only four of the seven sites undertook 
what might generally be called broad-based planning for Special Emphasis 
instruction. At the remaining three sites, planning of the project 
was limited to school district officials, the project director, the 
school principal, and the reading specialists. Only at the. Tennessee 
site was there evidence of the participation of community representa- 
tives and parents in the planning of the Special Emphasis program. Only 
three of the sites (Louisiana, Michigan, and West Virginia) identified 
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measurable oblectlves for Special Emphasis. For the most part, ob- 
jectives identified by local projects were process rather than outcome 
objectives— a factor which may have limited the precision and direction 
of the implementation. 

Skill Mastery Record Keeping Systems 

All Special Emphasis sites established skill mastery record 
keeping systems for tracking student progress in reading skills and 
charting the diagnostic-prescriptive approach. In California, the 
system in the basal reading series was used. In others, commercial 
reading management systems were us 2d such as DISTAR (Tennessee and 
Michigan) , Precision Teaching (Louisiana) , or Wisconsin Design (West 
Virginia); i.i some siter. (Mich.'.grja, Ohio, Texas), locally-devised, 
district-wide systems were used. In several instances, management 
systems were in place prior to Special Emphasis. 

Comparability of Special Emphasis and Comparison Schools 
Aside from the provisions for broad-based planning, th«: require- 
ment for comparable treatment and comparison schools was most probleinatic 
Only one of the Special Emphasis sites, Michigan, had treatment and 
comparison schools which ^ere truly comparable with respect to standard- 
ized reading scores, size, demographics, instructional program, staff, 
and facilities. Five of the sites—Louisiaua, Ohio, Texas, West 
Virginia, and California—were generally coi. ; rable. The Tennessee 
schools lacked comparability with respect to student demographics, 
standardized test scores, teacher experience, instructional programs, 
and school facilities. 



Project Administration 

Project administration involved different combinations of per- 
sonnel at each site, including LEA administrators, the Special Emphasi 
project director, the treatment school principal, and one or more of 
the reading specialists. 
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special Emphasis project directors represented a diverse group 
of education professionals. All seven had many years of experience in 
the field of education and were in recognized positions of leadership 
in the district where they served as director o£ the Special En^hasis 
Project. 

Time devoted by project directors to Special Emphasis ranged from 
5 to 40 hours per week. This time comsiitment varied according to the 
additional job responsibilities assigned most project directors. 
Within the extremes of 5 and 40 hours, three project directors spent 
10 hours a week and two spent: 20 hours a week on Special Emphasis 
activities . 

Four project directors were located off site in their school 
district's administrative offices (Louisiana, Michigan, Tennessi^e, and 
Texas). In general, these directors provided less supervision of 
project personnel and less guidance for program implementation. These 
project directors typically assigned responsibility for ongoing pro- 
ject activities to an individual located at the project school — a 
principal or reading specialist. Off site project directors seldom 
vis:.lted Special Emphasis classes. However, during their infrequent 
site visits they observed classes or showed visitors around. The 
primary functions of these directors in relation to the project read- 
ing program were to set guidelines for the conduct of the program, to 
provide inservice training, and to supply materials and staff. 

Louisiana, it appears, was an e ception to this pattern. The 
pr. ject director provided a great deal of direct supervision and was 
onsite to observe on a weekly basis. The fact that this particular 
project director developed the curriculum and materials used in the 
Title I program at these schools perhaps explains the greater degree 
of involvtement and supervision evident at this site. 
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At the remaining three sites— Ohio, West Virginia, and Cali- 
fornia—which had the project director colocated with the project, 
the director had greater supervisory presence. Weekly visits, fre- 
quently for observation, were characteristic. Teachers and reading 
specialists were in unanimous agreement that these directors assumed 
an active role. 

Project directors at all sites W6re responsible for establishing 
positive, cooperative relationships with the schools involved in the 
study. In the treatment schools, these relationships were nurtured 
through classroom/lab visits, inservice training meetings and dis- 
cussions, and availability for problem solving and technical assistance. 
The effectiveness of the project director in establishing these relation- 
ships was reflected in teacher attitudes toward the Special Emphasis 
project, which will be addressed in Section 5, Project Outcomes. 
Of particular concern was the relationship with comparison schools. 
These schools received none of the programmatic benefits of the Special 
Emphasis Project but were burdened by the semiannual testing and data 
requirements. Positive relationships existed at three sites (Louisiana, 
Tennessee, and Texas). The comparison school's staff at these sites 
had a basic understanding of Special Emphasis and the role of the 
comparison school. They received sufficient advance notification of 
the, evaluation team's visits, proposed activities, and data require- 
ments. On the other hand, resistance to the study team and Special 
Emphasis Project staff was evident at sites whem the comparison 
school felt uninformed. The staff at severa] - • schools refused 

to cooperate with various aspects of the study .g.. classroom teacher 

'nistration of the SORT, classroom observation, and. questionnaire 
response). Lack of information and appreciation for the study was not 
limited to the comparison schools; similar conditions existed at some 
treatment schools where teachers or reading specialists were not in- 
volved in the planning of the project. 



i 
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Administrative support from the LEA for the Special Emphasis proj- 
ects was not strong in all sites despite the fact that each school 
district voluntarily sought Special Emphasis Federal funds. While there 
was interest expressed in the project and in improving reading instruc- 
tion on a district-wide basis. Special Emphasis was clearly not an LEA 
priority undertaking at the majority of the sites. Two sites, Tennessee 
and Texas, exhibited unflagging administrative support with respect to 
space allocation, staffing, logistical and material support, timely 
decisions, and responsiveness to the requirements of the evaluation. 

CROSS SITE SUMMARY 

In summary, the cross site analysis reveals the following findings 

• Special Emphasis, as a reading intervention concept, was 

implemented with varying objectives, staffing configurations 



• All treatment schools utilized diagnostic-prescriptive 
approaches to reading instruction which were based on skill 
mastery systems and which were introduced through in- 
service, training sessions for teachers and reading spe- 
cialists. 

• Aside from the diagnostic-prescriptive approach, perhaps 
the most distinctive programmatic feature of Special 
Emphasis in four of the sites was assigning the reading 
specialists to teach in the regular classroom where the 
specialist H ^^n^-^ as role model, lead teacher, and techni- 
cal resource, llr^se. sites were Louisiana, Michigan, 
Tennessee, and Texas, 

• Implementation data with respect to the Special Emphasis 
Guidelines revealed compliance along all major dimensions 

' only in Louisiana and Texas. Ohio and California failed 
to serve all first and second graders; Michigan failed to 



and instructional approaches reported in the respective 

si :.es. 
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serve all eligible students (grades 3-6) as well as to provide 
the 40 minutes of instruction. Broad-based planning was 
not present in Michigan, West Virginia, and California. 
A review of schools, programs, and 9^ .uuut characteristics 
indicates broad comparability between the treatment and 
comparison school in each site except Tennessee. 

• Adminii itive configurations varied from site to site. 
Strongest leadership appeared to be in Louisiana, Tennessee, 
and Texas where LEA involvement and onsite educational 
leadership were most evident. 

• As indicated in the implementation matrix in Table A. 46, 
the highest degree of implementation of Special Emphasis 
took place in Tennessee, Louisiana, and Texas. Common 
characteristics among these three. sites were: (1) strong 
LEA support, (2) onsite management and leadership, (3) 
educational leadership with respect to curriculum and 
instruction, (4) staff development which was well attended 
and received by the teachers, and (5) classroom teacher 
participation in program planning. 

These site-specific findings and cross-site comparisons provide 
the context and the interpretive basis for the project outcomes which 
are described in the next section. 
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SECTION 5 
PROJECT OUTCOMES 



INTRODUCTION 

Three types of project outcomes are presented in this section: 

• Program Impact— Results of the covariance analysis of 
"whole grade" cohoii. gr nps, the covariance analysis of 
"below mean" cohort groups, and the trend analyses of 
students reading 1 or more years beJow grade level. 

• Attitudin al and Behavioral Findin f^s— Rpanl ^g of the ques- 
tionnaire surveys of teachers, students, and parents. 

• Residual Effects of Sp ecial Emphasis— ThP institutionalized 
"carry over" of concepts, practices, and procedures in 

the local site after the end of program funding. 

For the analysis of program impact for each site, tabular summaries 
are provided for the: 

• Covariance analyses of "whole grade" cohort groups for 
project years 1977-78 and 1978-79 and the 1977-79 period. 
Complete data for each site are contained in Appendix E. 

• Covariance analyses of "below mean" cohort grcups for proj- 
ect years 1977-78 and 1978-79. Complete data for each 
site are contained in Appendix F. 

• Trend analyses of students reading 1 or more years below 
grade level. Complete data for each site are contained 
in Appendix D. 

The analytic results for the whole grade groups apply to only those 
-.dents who comprise the analytic samples. Attention should be directed 
to the results of the preliminary anal/s: i to determine whether the 
analytic results can be generalized to thn participating student groups 
as a whole. In particular, confidence in the representativeness of 
the results will be limited by: 
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• Any non- comparability between the Special Emphasis and 
comparison groups along educationally relevant variables 
(as described in Section 4) . 

• The effects of attrition on the representativeness of the 
students included in the analytic sample and the representa- 
tiveness of their test scores in the analysis (see Appendixes 
A, B, and D) • 

• The influence of ceiling effects as they relate to the 
over- or underestimation of growth in reading achievement 
(as documented in Appendixes C and E; , 

The analytic results of the below mean analysis are presented 
to support results for those students for whom the Special Emphasis 
Program was intended. Caution must be exercised in their interpreta- 
tion to the extent that: 

m The proportions of below mean students for the treatment 
and comparison groups are not equal. 

• The below mean treatment and comparison groups show a preponderance 
of negative measurement error in the score distributions. 

A further discussion of the analytic methodology is contained in 
Section 3, Appendix G, and Volume II. 

For the analysis of attltudinal and behavioral findings, tabular 
summaries are provided for questionnaire surveys of teachers, parents, 
and students. The residual effects of Special Emphasis ware documented 
during onsite observations and interviews with project staff and were 
noted in responses to specific open-ended questions on the classroom 
teacher questionnaire. 

A discussion of each of the three types of project outcomes for 
each site is contained in the following subsections. A cross site 
summary concludes this s^iction of the report. 




LOUISIANA 



Summary 

The ANCOVA perfonned for the "whole grade" cohort group revealed 
statistically significant differences between the Special Emphasis and 
the comparison groups in project year 1977-78 and 1978-79 at grades 2 
and 5. The ANCOVA performed for the "below mean" cohort group indicated 
statistically significant differences at grade 2 for 1977-78 and 1978-79 
and also for grades 4, 5, and 6 in 1978-79. These differences may be 
more a function of the large differences in the sample sizes between 
Special Emphasis and comparison than any true differences between the 
two groups. While more students in both treatment and comparison 
schools tended to fall 1 or more years below level as they moved up 
grade levels ^ the Special Emphasis school did not "lose ground" as much 
as did the comparison school. 

Teacher perceptions of their students, their peers, and the 
principal's reading- related attitudes and behaviors ?:howed in both 
schools, but to a greater degree in the treatment school. Special 
Emphasis school teachers were highly supportive of the Special Emphasis 
Project. 

The following subsections describe in detail t\ - project outcomes 
for Louisiana. 

Covarian ce Analysis of "Whole Grade" Cohort Groups 

The summary of the ANCOVA for each grade in the Special Emphasis 
and comparison schools in Louisiana is contained in Table 5.1, ANCOVA 
Impact Summary. For project year 1977-78, statistically significant 
differences iii the adjusted posttest scaled scores were identified for 
grades 2 and 5. In both instances, the adjusted posttest scaled scores 
for the Special Emphasis group *»xceeded those of the comparison group. 
In addition, the average observed change in grade equivalent for both 
the second and fifth grade comparison groups was below the average 
growth of .6 years expected fo- low achieving students. The average 
observed change in grade equivalents for second and fifth grade Special 
Emphasise groups was .8 and 1.1 years, respectively. 
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TABLE 5.1 
ANCOVA IMPACT SUMMARY 



sua: LOUISIANA 



Grade 
initial 
Year 

2 



rwUKCT YEAR 
iVl-WA. 



6 



Siiiool 

S.E. 
C. 

S.li. 
C. 

S.E. 



S.E. 
C. 

S.E. 
C. 



Sig. 
nl 

L. 
.01 



N.S. 



N.S. 



.02 



N.S. 



Direction 
ol 

Itipact 

S.E. 



S.E. 



Cliange 
In 

Ctjqulv. 

^0.8 
+0.5 



+1.1 
+1.2 



+0.5 
+0.9 



+1.1 
+0.2 



+1.0 
+0.8 



Grade 
Initial 

.lcnr__ 

2 



Sdiool 

S.E. 
C. 

S.E. 
C. 

S.E. 
C. 

S.E. 
C. 



S.E. 
C. 



m 
sig. 

of 
..I 

M 



N.S. 



N.S. 



.01 



N.S. 



GRADE 

Di rectlon 
of 

Iniiwt _ 
S.E. 



S.E. 



liiange 
In 

Gr.Jgulv. 

+0.9 
+0.6 



+0.9 
+1.2 



+0.9 
+0.9 



10.9 
+0.1 



+1.5 
+0.9 



^^ ■ Due to error In coding grade 4 spring 1977 SDHT. 



Grade 
Initial 
.lfear__ 

2 



P«nJECT7EAiis 

--,WH979 

Direction 
ul 

Jjf act _ 



School 

S.E. 
C. 

S.E. 
C. 

S.E. 
C. 



S.E, 
C. 



S.E. 
C. 



Sig. 
of 

F 



N/A 



.02 



N.S. 



.02 



S.E. 



Cliange 
in 



No Aialyali! Pos 



S.I!. 



+1.7 

+1.9 

112 



Ibic 



+2.2 
+1.2 



PRO.)ECT YFiR 
197M978 



Grade 
Initial 
Year 



School 



2 



S.E. 
C. 



S.E. 
C. 

S.E. 
C. 

S.E. 
C. 

S.E. 
C. 



vlg. 

of 
-i- 

<.01 



N.S. 



N.S. 



N.S. 



N.S, 



Direction 
of 

Ji!ipact_ 
S.E. 



Km GRAi)E"HEAN 



Change 
in 

Gr^qiilv. 

+1.0 
+0.5 



10.8 
+ 1.0 

10.5 
+0,6 

+0.6 



+1.1 
+0.5 



PROJECT YFJIR 



Grade 
Initial 
Year 


School 


Sig. 
of 
F 


Direction 

of 
Iniiact 


2 


S.E, 
C. 


.02 


S.E. 


3 


S,E, 
C. 


N.S. 




It 


S.E. 
C. 


.05 


S.E. 


5 


S.E. 
C. 


<.0l 


S.E. 


6 


S.E. 
C, 


.01 


S.E. 











in 

Gr. Eguiv. 

>+2.1 
+0,5 

+1.1 
+0.9 

+0.9 
+0.6 

+0.4 
+0.1 

+1.0 
+0.3 



For project year 1978-79, a statistically significant difference 
in adjusted posttest scaled scores was again identified for grades 2 
and 5. In both these instances, the performance of the Special Emphasis 
groups exceeded that of the corresponding comparison groups. The 
average observed change in grade equivalent was .9 years for grade 2 
and grade 5 Special Emphasis groups. For the comparison groups, the 
average change in grade equivalent was .6 and .1 for grades 2 and 5, 
respectively. Attention should be directed to the presence of serious 
ceiling effects (refer to Tables E.l and E.2 in Appendix E) for the 
grade 2 posttest scores and the grade 5 pretest scores for both the 
1977-78 and the 1978-79 project years leading to an underestimate of 
observed change in grade equivalent for grade 2 and an overestimate 
of the observed change in grade equivalent for grade 5. 

For the 1977-79 period, statistically significant differences in 
adjusted posttest scaled scores were identified for the grade 3 and 
grade 6 "whole grade" groups. The grade identified is the grade com- 
pleted in spring 1979. For grade 3, the observed change in grade 
equivalent was 1.8 years for the Special Emphasis group and 1.7 years 
for the comparison group. For grade 6, the observed change in grade 
equivalent was 2.2 years for the Special Emphasis group and 1.2 years 
for the comparison group. It should be noted that serious ceiling 
effects were encountered for the grade 6 pretest (refer to Table E.3 
in -Appendix E) indicating that tie observed change in grade equivalent 
is an overestimate of the true change. 

Covariance Analysis of "Below Mean" Cohort Groups 

For project year 1977-78, the ANCOVA indicated a significant 
difference in the adjusted posttest scores for the grade 2 Special 
Emphasis and comparison "below mean" groups (refer to Table 5.1, 
ANCOVA Impact Summary). This result parallels the result for the 
"whole grade" analysis for grade 2 for project year 1977-78. The 
Special Emphasis "below mean" group had an average observed change in 
grade equivalent of 1.0 years compared to .8 years for the grade 2 
"whole grade" group. The grade 2 comparison "below mean" group had 



5-5 



an observed change in grade equivalent of .5 years, the same as its 
corresponding "whole grade" group. It should be noted (refer to Table 
F.l in Appendix F) that the mean pretest scaled score for the grade 2 
Special Emphasis group was substantially less than that for the grade 2 
Comparison group (230 vs. 273) and that the sample sizes for all Special 
Emphasis "below mean" groups were between 13 and 19 students. 

For project year 1978-79, the ANCOVA indicated significant 
differences in adjusted posttest scaled scores for grades 2, 4, 5, 
and 6. In each instance, the performance of the Special Emphasis 
"below mean" group exceeded that of the corresponding comparison 
group. It should be noted that for the " whole grade" groups, there 
were similar statistically significant differences for grades 2 and 
5. 

Trend Analysis of Students Reading 1 or More Years Below Grade Level 

Table 5.2, Trend Analysis of Students Reading 1 or More Years 
Below Grade Level, combines data from Tables D.l through D.3 in Appendix 
D to provide a trend analysis of the percentage of students in grade 
cohorts reading 1 or more years below grade leyel in 1977, 1978, and 1979. 



TABLE 5.2 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



SlC«: LOUISIANA 



Tr«Atnnt School 



Grade 



Spring 

1977 


Spring 
1978 


Spring 
1979 


Z 


X 


Z 


17 


8 


11 


22 ^ — 


. 29 


23 


57 


. 59 




63 


. ^8 


63 


59 "^^^ 


69 


">s. 49 




37 


37 


31 



Conparlaon School 



Sprlnit 
1977 


Spring 
1978 


Spring 
1979 


Z 


Z 


Z 


19 


12 


7 


23 


17 


^ 19 


53 


51 "Ns. 


^ 39 


" >^ 


65 


. 70 


55 "^^N^ 


56 "\s. 


. 62 




35 


32 


32 



._ J 



._ J 

._ J_ 



School local 
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In almost all cases, as students progress in grade level, a larger 
percentage of students read more than 1 year below grade level. Over the 
period 1977-79, there is a decrease in the percentage of second grade 
students reading 1 or more years below grade level; from 17% to 11% in 
the treatment school and from 19% to 7% in the comparison school. 

Table 5.3, Numbers of Students Reading 1 or More Years Below Grade 
Level, shows that overall a greater number of students tested at both 
points (spring to spring) were reading 1 or more years below level by 
the end of the project year than at the beginning of the project year. 
For the Special Emphasis school, there was a 5-6% increase each year 
from 38% to 43% in 1977-78 and from 34% to 40% in 1978-79; for the com- 
parison schools, a 6% increase from 29% to 35% and a 9% increase from 
25% to 34% in 1977-78 and 1978-79, respectively. The Special Emphasis 
students do not appear to be falling 1 or more years below grade as 
rapidly as the comparison school students. 



TABLE 5.3 

NUMBERS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



sice: LOUIS lANA 



i 
I 


Treacmenc School . ComTsarison School. 


1 

■ 1, local scudears cesced ac 
I boch poincs* 

1 

1 ' . — 


1977-78 1978-79 
177 170 


rroTecc tear 
i 1977-73 1978-751 

i 

335 387 ! 

t 


i 3feeinnia« of Pro^ecc Year 

12. N'o. scudencs cescad > 1 year 
below grader 

3. Z of cocal scudencs 
(line 2/liae 1) 


68 57 
38Z 34% 


1 

j 

98 96 

292 25Z i 

1 


End of Prolecc Vear 

^. No. scudencs cesced > 1 year 
below gradei 

5. of rocal scudencs 
(line 4/line 1) 


76 69 

j 


i 

116 130 : 

1 
1 

35r i 


* — 



Spring 19 77 and spring 1978 for 1977-78 

Spring 1978 and spring 1979 for 1978-79 

Spring 1977 for 1977-78 and spring 1978 for 1978-79 

"^Spring 1978 for 1977-78 and spring 1979 for 1978-79 
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Attltudlnal and Behavioral Findings 

Changes in reading-related attitudes and behaviors were investi- 
gated in 1978 and 1979. The major findings of this investigation are 
reported for the various response groups below. 



Teachers at the Special Emphasis schools reported positive 
reading attitudinal and behavioral change on the part of 
their students in 1978 and in 1979. Improvement in the 
attitudes of their colleagues and principal was also 
reported each year. (Tables 5.4 and 5.5) 

At the comparison school, a more positive change in student 
attitudes and behaviors and colleague and principal atti- 
tudes were reported in 1979 than 1978. (Tables 5.4 and 5.5) 

Teachers at the Special Emphasis schools reported no major 
problems as a result of their participation in this project. 
Minor concerns included the feeling that reading was empha- 
sized at the expense of other programs and conflict between 
teachers and reading specialists. (Table 5.6) 

Comparison school teachers expressed considerable resentment 
towards the project in 1978. This abated in 1979. (Table 



Students and Parents 

• In 1979, differences were observed in reading attitudes and 
behaviors between the Special Emphasis and comparison- schools 
third graders. (Table 5.7) 

• In 1978 and 1979, little difference was observed in the data 
from fourth, fifth, and sixth graders at the Special Emphasis 
and comparison schools. (Table 5.8) 

• ' In 1978 and 1979, no significant differences were noted in 

the Special Emphasis and comparison parent groups. (Table 



Teachers 



5.6) 



5.9) 
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No comparisons of attitudes and behaviors of grade 3 students can 
be made for 1978 because student surveys were not received from the 
Special Emphasis schools. 

Residual Effects of Special Emphasis 

While school district officials have some problem distinguishing 
the benefits derived from Special Emphasis from those derived from 
their Title I Precision Teaching System, they claimed that some of the 
lessons learned in Special Emphasis will be carried over in Title I. 
Special Emphasis as a total approach, however, will not be carried 
over due to the expense involved. 

School principals observed that the Special Emphasis Program 
enhanced their teachers' instructional capability. Responding to the 
growing teacher concern for diagnosing skills and grouping students, all 
first graders will undergo diagriostic testing for placement. School 
staff also felt that Special Emphasis made a breakthrough in getting 
parents ^.nvolved in signing completed worksheets. 

Several project staff pointed to the potential for further carry 
over owing to the appointment of one of the project reading specialists 
to the position of curriculum coordinator for the school district. 

Seventy-three percent of the teachers felt certain that Special 
Emphasis had influenced their performance —in individualizing approaches 
in focusing on specific skill development, and in the use of materials 
and techniques. 
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TABLE 5.4 
TEACHERS' ASSESSMENTS OF ATTITUDES 



Sits: LOUISIAKA 



School: SPECIAL E^iFHASXS 


r"^r""T Effect 

iMchArs ' 

lAasttssiatixc of: ' 


PosiCiva 
Changa 

X 


No 
Chaaga 

X 


Negaclva 
Change 
X 


Canaoc 
Tall 
Z 


No 

SaspOQsa 

Z 


Stuic:«cs' ACtlcudM 
covmrd reading 


1978 


92 


8 








1979 


91 




9 






TMchers' ACtlcudss covArd 
rMdl&g Inscxuctlon 


1978 


100 










1979 


100 










Principals' ACCltudea 
coward raadiag prograa 


1978 


100 










1979 


91 








9 



School: COMPA&ISON 



j • ^^^^^^^ Efface 

iTaaehars ' 

lAasaaaiatnc of: . — 


Poaiciva 
Change 

X 


No 
Change 

X 


Negacive 
Change 

Z 


Cannoc { 
TaU 
X J 


No 

Response 
X 


Iscudanta' accicudas 


1978 


43 


19 


5 




33 


j coward reading 


1979 


77 


12 




12 




jraaebars' accictvi«a coward 


1978 


38 


24 


5 ! - 


33 


peading inscraction 


1979 


65 


23 


4 




4 


jPriaeipala' accicudaa 


1978 


43 


24 


- 1 - 


33 


coward reading prograa 


1979 


54 


U 


1 31 


4 



'^Noit-raaponae or rounding eaciaacea are responsible for row cocals below or above 

ICdX. 
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TABLE 5.5 

TEACHERS' ASSESSMENTS OF STUDENT READING BEHAVIORS* 



Sle*: LOniSIAHA 



School: SPECIAL EMPHASIS 


T«ach«rs' Effect 
Scudttit BMdlng B«h«vlor«"'**'*''*-^ 


Posltivt 
Chaaga 

Z 


No 
Changa 
X 


NagaL^va 
Changa 
X 


Cannoe 
TaU 
X 


No 

Rasponaa 

X 


Tim tp«ac r««dliis 


1978 


83 


8 






8 


1979 


100 










TlM apcnc rft«dlng 
oucslds of elMM9 


1978 


58 


17 






25 


1979 


82 


9 


- 


9 




Library aod/or 
claMrooa book uaaga 


1978 


100 










1979 


100 


- 1 ■ - 







School: COMPARISON 



Taacbars ' Efface 
Aaaasaaanc of 

Scudant Raadins Bahavlora "^""^-^ 


Foalelvs 
Chasga 
X 


No 
Changa 

X 


: Nagaelva 
Changa 

X 


Cannoe 
TaU 

X 


No 

Raaponaa 


Tiat apanc raading 
in eXaaa 


1978 


43 


19 






38 


1979 


^9 1 8 




4 


- 


Tlaa spaat raading 
joutalda of elaaa 


1978 


33 


24 




- 


43 


1979 


58 


4 


- 1 39 


- 


Library and/or 
daasroott book uaaga 


1978 


48 


14 


. 1 . 


38 


1979 


92 


- 1 . 1 « 





i-rupona* or rounding es duces are responsible for row eocels below or above 
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TABLE 5.6 

TEACHER CONCERNS RESULTING FROM SPECIAL EMPHASIS INVOLVEMENT* 
Site: LOUISIANA 



School: SPECIAL EMPHASIS 





Year 


Major 
Problem 
% 


Minor 
Problem 
% 


Not A 
Problem 
% 


Teacher dissatisfaction with 
project objectives 


1978 




8 


84 


1979 




9 


91 


Conflict between project objectives and 
other district objectives 


1978 






92 


1979 






91 


Teacher feelings that reading Is 
emphasized at expense of other programs 


1978 




25 


67 


1979 




9 


82 


Conflict between teachers and reading 
specialists 


1978 




8 


84 


1979 




18 


82 



School: COMPARISON 





Year 


Major 
Problem 
% 


Minor 
Problem 
% 


Not A 
Problem 
% 


Teacher resentment of administering 
tests to students not benefiting 
from the project 


1978 


24 


29 


24 


1979 


8 


12 


77 


Teacher resentment of extra work without 
receiving new materials or other support 


1978 


29 


24 


24 


1979 


15 


35 


43 


Parental complaints about 
testing 


1978 




5 


71 


1979 




15 


77 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 


14 


10 


43 


1979 


4 


19 


69 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.7 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADE 3* 
LOUISIANA 
1978 





School 


Yes 
Z 


Some- 
times 
Z 


No 
Z 


Reading Is fun 


Special 
Emphasis 


- 


- 


- 


Comparison 


50 


46 


3 


I like to read during 

HlV fre^ timp 


Special 
Emphasis 


- 


- 


- 


Comparison 


59 


36 


4 


I like my reading class 


Special 
Emphasis 








Comparison 


63 


25 




I read only when 
I have to 


Special 
Emphasis 








Comparison 


55 


22 


22 


Year: 1979 






School 


Yes 
Z 


Some- 
times 

% 


No 
Z 


Reading is fun 


Special 
Emphasis 


84 


14 


2 


Comparison 


76 


13 


3 


I like to read Cr.;:ing 


Special 
Emphasis 


34 


52 


14 


my free time 


Comparison 


60 


25 


6 


I like my reading class 


Special 
Emphasis 


48 


39 


14 




Comparison 


63 


19 


9 


I read only when 


Special 
Emphasis 


21 


52 


27 


I have to 


Comparison 


52 


8 


31 



* 

Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.8 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADES 4-6 * 
Site: LOUISIANA 
Year: 1978 



Reading Attitudes 


School 


Yes 

% 


Some- 
Tlmes 
% 


No 
% . 


Do you like to read? 


Special 
Emphasis 


54 


40 


4 


Comparison 


49 


48 


2 


Do you read better this year 
than last vear? 


Emphasis 


73 


19 


6 


Comparison 


79 


4 


17 


Reading Habits 


-School 


0 

Z 


1-5 

Z 


6+ 
% 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


25 


61 


14 


Comparison 


23 


56 


21 


How many books have you 
read during the past month? 


Special 
Emphasis 


11 


36 


53 


Comparison 


7 


44 


49 



Year: 1979 



Reading Attitudes 


School 


Yes 

% 


Some- 
Tlmes 
% 


No 

% 


Do ypu like .to read? 


Special 
Emphasis 


54 


42 


4 


Comparison 


50 


44 


2 


Do you read better this year 
than last year? 


Special 
Emphasis 


94 


1 


5 


Comparison 


89 


3 


8 


Reading Habits 


School 


0 

'% 


1-5 

% 


6+ 

% 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


25 


57 


18 


Comparison 


13 


70 


17 


How many books have you 
read during the past month? 


Special 
Emphasis 


5 


35 


60 


Comparison 


6 


18 


76 



ERIC 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABi.1:- 5 . -J 
SUMMARY OF PARENT SURVEY* 



Site: LOUISIANA 
Year: 1978 





School 


Yes 
Z 


No 
Z 


Cannot 
Say 
Z 


Does your child share books 
with you or your family? 


Special 
Emphasis 


71 


23 


5 


Comparison 


75 


19 


4 


Does the school set up 
parent /teacher conferences? 


Special 
Emphasis 


30 


52 


16 


Comparison 


30 


55 


12 


Have you worked as a 
voltmteer in your child's 
school this year? 


Special 
Emphasis 


4 


77 


2 


Comparison 


9 


76 


2 



Year: 1979 





School 


Yes 
% 


No 
1 


Cannot 
Say 
I 


Does your child share books 
with you or your family? 


Special 
Emphasis 


82 


15 


2 


Comparison 


88 


9 


1 


Does the school set up 
parent/teacher conferences? 


Special 
Emphasis ' 


47 


31 


20 


Comparison 


40 


37 


20 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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Summary 

Tl-ie covariance analyses of reading comprehension test scores 
revealed no consistent patterns of differences between the Special 
Emphasis and comparison groups. Significant differences were observed 
in two instances in the "whole grade" analysis and in two instances in 
the "below mean" analysis. In each of these cases, the findings favored 
the comparison school. 

Teacher perception of positive attitudinal change among students 
and peers high in both schools in 1978 and slightly lower in 1979. 
Teacher perception of students' reading behaviors was similar for both, 
schools in 1978, but slightly higher in the the conqiarison school in 
1979. There were no observed carry over effects from Special Emphasis 
in Michigan. 

Project outcomes for the Michigan site are further described in 
the following subsections. 

Covariance Analysis of "Whole Grade" Cohort Groups 

Table 5.10, ANCOVA Impact Summary, provides a summary of data 
contained in the ANCOVA tables shown in Appendixes E and F. 

As can be seen in Table 5.10, there were no statistically signi- 
ficant differences between the Special Emphasis and comparison schools 
for 1977-78. 

For project year 1978-79, statistically significant differences 
in the adjusted posttest scaled scores were identified in grades 3 and 
5. In each case, the adjusted posttest scaled scores for the comparison 
group were higher than those for the Special Emphasis group. At the 
grade 3 level, the average observed change in grade equivalent was 1.0 
for the Special Emphasis group and 1.3 for the conq)arison group. At 
thg grade 5 level, the coraparison group achieved an average observed 



TABLE 5.10 
ANCOVA IMPACT SUMMARY 



Sice: HlClltCAN 



i 

H 

00 







UIIOLE GRADE 


PROJECT m 
Whim 






PROJECT YEAR 
197B-1979 






PROJECT YEARS 
1977-1070 


Grade 

Initial 

Year 


School 


of 
F 


Direction 

of 
Inpact 


Change 
In 

Gr. Equlv. 




Grade 

Initial 

Tear 


School 


Sig. 
of 
F 


Direction 

of 
Impact 


Change 
In 

Gr, Equlv. 




Grade 
Initial 
Year 


School 


Sig. 
of 
F 


Direction 
of 

111 


Cliange 

In 

111 


2 


S.E. 

c. . 


N.S. 




W.5 

TV. J 




2 


S.E. 


N.S. 




+0.8 
+0.7 




2 


S.E. 
C. 


N/A 






,1 


S.E. 

,c. 


N.S. 


- 


+1.0 
+0.9 




3 


S.E. 

c. 


.02 


C. 


+1.0 
■ +1.3 




3 


S.E. 
C. 


N.S. 




+1.6 
11 R 


k 


S.E. 
C. 


N.S, 




+0.6 
+0.7 




k 
1 


S.E. 
C. 


N.S. 




+0.7 
+0.5 




4 


S.B. 
C. 


N.S, 




+1,7 
+1.5 


5 


S.E. 
C. 


N.S. 




0 

-O.l 




5 


S.E. 
C. 


.01 


C. 


0 

+0.6 




5 


S.E. 
C. 


N.S. 




+0.t 
+0.9 


6 


S.B. 
C. 


N.S. 




+0.9 
+1.0 




(i 


S.E. 
C, 


N/A 








6 


S.E, 
C. 









ERIC 



BEIOU GRADE NEAN 



PROJECT YEAR 
1977-197B 




PROJECT YEAR 
1978-1979 


Grade 

Initial 

Year 


School 


Sig. 
of 
F 


Direction 

of 
Inpact 


Change 
in 

Gr. Equiv. 




Grade 
Initial 
Year 


Scliool 


Sig. 
of 
P 


Direction 

of 
Inpact 


Change 
in 

Cr. Equlv. 


2 


S.E. 
C. 


N.S. 




+0,6 
+0.6 




2 


S.E. 
C, 


N.S. 




+0,9 
+0.9 


3 


S.L. 

,c. 


,02 


c. 


+0.8 
+1,0 




3 


S.E. 
C. 


N.S. 




+0.9 
+1.0 




S.E. 

c. 


N.S, 




+0.4 
+0.5 

1 




4 


S.E. 

C, 


N.S, 




+0.3 

m 


5 


S.E, 
C. 


N.S, 




0 

+0.1 




5 


S.E. 

C. , 


M 


C. 


-0.1 
+0.3 


6 


S.E. 
C. 


N.S, 




+0.7 
+0.6 




6 


S.E. 
C. 


N/A 







change in grade equivalent of .6 (the expectation level for "low achieving" 
students) and the Special Emphasis students achieved an average observed 
change in grade equivalent of 0. Ceiling effects present in the pre- 
snd posttest scores for both grade 3 groups preclude any meaningful 
interpretation of gain. Similarly, ceiling effects in the grade 5 

pretest scores result in an overestimation of observed change in grade 
equivalent at that level. 

For the 2-year period, 1977-79, there were no statistically signi- 
ficant differences between the Special Emphasis and comparison groups. 

Covarian ce Analysis of "Below Mean" Cohort Groups 

Focusing on those students scoring below the mean on the prestest 
for project year 1977-78, there was a statistically significt^nt differ- 
ence favoring the comparison school for grade 3. For the "below mean" 
comparison group, there was an average observed change in grade equiva- 
lent of 1.0; while for the Special Emphasis "below mean" group the 
average observed change was .8 years. TheANCOVA did not produce a 
statistically significant difference for the "whole grade" grade 3 
groups . 

In project years 1978-79, there^as a statistically significant 
difference favoriiig the comparison "below mean" group for grade 5. 
Th±s finding parallels the ANCOVA outcomes for the "whole grade" group 
for the same project year. In this instance, the comparison school 
students had an average observed change in grade equivalent of .3 years 
vs. .1 for the Special Enq)hasis "below mean" group. 

Trend Analysis of Students Reading 1 or More Years Below Grade Level 

Data on numbers of students reading 1 or more years below grade 
level (which is detailed iu Appendix D) are aunmarized in Table 5.11. 
These data provide a trend analysis of the percentage of students in 
grade cohorts reading 1 or more years below grade level in 1977, 1978, 
and 1979. 
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TABLE 5.11 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



Site: MICHIGAN 

Treatment School j Cogparlson School 

Spring Spring Spring | Spring Spring Spring 
Gyade 1977 1978 1979 1977 1978 1979 




Schopl Total 38 37 31 44 40 29 



Overall, the rate of students falling below grade is similar for 
both schools. The drop in total percentage of students below grade 
level appears to be related to the entry of students who were not pre- 
viously tested and the exit of students no longer in the program. Second 
grade students in each school did progressively better each year, with 
the 1979 second graders in the ccn5)arison school having far fewer stu- 
dents below level than the second graders the year before. 

Table 5.12, Number of Students Reading 1 or More Years Below 
Grade Level, shows that overall for students tested both at the begin- 
ning and end of each project year a greater percentage- were reading 1 or 
more years below grade level at the end of the project year than at the 
beginning of the project year. In 1977-78, the percentage of students 
reading 1 or more years below grade rose by 11% from 33% to 44% in the 
Special Emphasis school and by 12% from 35% to 47%, in the comparison 
school. In 1978-79, both schools experienced a 12% increase in the 
number of students reading 1 or more years below grade level. The 
rate at which students are falling 1 or more years below grade level 
is similar for both the treatment and comparison schools. 
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TABLE 5.12 

NUMBER OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



sice: MICHIGAN 





Treacnenc School Comoarxson Schooli 


Proiecc Year i Proi^rr '-'^^jr 


I. local scudencs cesced ac 
both poiacs* 


j 1977-78 1973-79 
391 338 


1977-73 1973-791 

i 

308 267 ! 

i 


Be^inninsi oc ?ro1ecr Year 

2. N*o. scudencs cesced > 1 /ear 
below grade" 

3. Z of cocal scudencs 

(line 2 /line 1) 


131 75 
33Z 222 


1 
1 

t 

j 

109 57 i 

i 

35: 21% ! 

t 

1 


End oc Proiecc Year 

4. No. scudencs cesced > 1 vear 
below grades 

5. ; of cocal scudencs 
(line 4/ line 1) 


172 115 
442 34Z 


t 
1 

! 

145 89 1 

1 
1 

1 



* 

Spring 1977 and spring 1978 cor 1977-78 

Spring 1978 and spring 1979 cor 1978-79 

[spring 1977 for 1977-78 and spring 1978 for 1978-79 

Spring 1978 for 1977-78 and spring 1979 for 1978-79 



Attitudinal and Behavioral Findings 

Survey data regarding reading attitudes and behaviors was analyzed 
for 1978 and 1979. A summary of the major findings from the various 
respondent groups is presented below. 



Teachers 



In 1978, student reading attitudes and behaviors improved 
at the Special Emphasis school. Comparison school teachers 
also reported positive changes in students. In 1979, 
improvement in student attitudes and behaviors were again 
reported although the percentage of teachers reporting such 
change dropped. (Tables 5.13 and 5.14) 
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• In 1978, teachers* attitudes showed improvement at the Special 
Emphasis and comparison school. A drop in teacher percep- 
tion of change occurred in 1979. (Table 5.13) 

• In 1978 and 1979, not all teachers at the Special Emphasis 
school were happy with Special Emphasis. The most frequently 
mentioned concerns were conflict between teachers and read- 
ing specialists and dissatisfaction with project objectives. 
(Table 5.15) 

• In 1978 and 1979, comparison school teachers resented the 
testing and additional work Special Emphasis imposed upon 
them. (Table 5.15) 

Students and Parents 

• In 1978, data from Special Emphasis and comparison school 
third graders show divergent reading attitudes and behaviors. 
(Table 5.16) 

• In 1979, data from Special Emphasis and comparison school 
third graders suggest they were more similar in reading 
attitudes and behaviors. (Table 5.16) 

• In 1978 and 1979, Special Emphasis and comparison school 
fourth, fifth, and sixth graders have similar reading 
attitudes and behaviors. (Table 5.17) 

• In 1978 and 1979, parent survey data show only slight 
differences in parent responses from the Special Emphasis 
and comparison schools . (Table 5.18) 



Residual Effects of Special Emphasis 

The project school in Michigan appears to be devoid of residual 
effects from Special Emphasis. In retrospect, neither district adminis- 
trators nor school staff were able to identify any specific carry 
over in policies, procedures, or practices as a result of Special 
Emphasis This situation may well reflect the lack of planning, direc- 
tion, and district commitment which was apparent to the study team 
during the course of this evaluation. 




TABLE 5 .13 
TEACHERS* ASSESSMENTS OF ATTITUDES 



SlCtt: MICHIGAN 



School: SPECIAL EHPHASIS 



X.achlirr^ Efface 

Aaattssntnc of: .^.^^ 


Poaldva 
Chaags 

Z 


No 
Changtt 

Z 


Nttgaclva 

Chaag€ 
Z 


Connoc 
TtU 
Z 


No 

Rftspoast 
Z 


Scud«ncj' acrltudM 
coward reading 


1978 


84 


8 


a 






1979 


53 


29 




12 


6 


Ttachera' acclotdM covard 


1978 


64 


32 


4 






raadlng laacruccion 


1979 


47 


41 


6 




6 


Principals' actltudfts 


1978 


24 


16 






60 


tovard raadlng progran 


1979 


24 


24 




41 


12 



School: COMPARISON 



^ Efface 

Aaaaaamaac of: 


Poslclva 
Changa 

Z 


No 
Changa 
Z 


Nagadva 

Change 
Z 


Cannoc 
Tall 
Z 


No 

Raspons* 
Z 


Scudancj' accltudaa 


1978 


91 


10 


- 


- 




covard raadlng 


1979 


61 


17 


- 


17 


6 


Taachara' acdtudas covard 
Iraading inacruecloa 

1 


1978 


71 


19 




- 1 10 


1979 


44 


— 22 




"22 


11 


Prladpala* acclcudas 
covard raadlag program 


1978 


19 


29 




- 1 52 




1979 


17 


22 




50 


U 



i-raaponaa or rounding aadaacaa ara reaponalbla for row cocals. balow or abova 
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TABLE 5-14 

TEACHERS' ASSB.SSMENTS OF STUDENT READING BEHAVIORS* 



SiC«: MICHIGAN 
School: SPECIAL EMPHASIS 



T««ch«r» ' ■■ — Effect 
Student Reading Behevlora — ^ 


Positive 
Change 
Z 


No 
Change 
Z 


Negative 
Change 
Z 


Cannot 
Tell 
Z 


No 

Response 

Z 


Tioe spent reeding 
in elsee 


1978 


72 


28 








1979 


47 


47 






6 


Tiae spent reeding 
outside of class 


1978 


44 


36 


20 




1979 


35 


35 


24 


6 


Ubrary ^id/or 
classroom book usaga 


1978 


68 


20 


12 




^979 


53 


35 




6 


6 



School: COMPAaiSON 



iXeachers ' Effect 

Assessment o£ 

Student Raading Behaviors 


Positive 
Changa 
Z 


No 
Change 
Z 


Negative 
Changa 
Z 


Cannot 
TeU 
Z 


No 

Response 


Time spent reading 
in class 


1978 


81 


5 


- ! - 


14 


1979 


78 


11 


- 1 6 




Time spent reading 
outside of class 


1978 


57 


14 


- 1 - 


29 


1979 


61 


17 


- 1 17 




Ubrary and/or 
jdassrooa book usage 


1978 


90 


5 






1979 


61 


11 




11 


16 



Non-response or rounding astiaacea are reaponaible for row totals below or above 
lOOZ. 
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TABLE 5.15 

TEACHER CONCERNS RESULTING FROM SPECIAL EMPHASIS INVOLVEMENT* > 



Site: MICHIGAN 
School: SPECIAL EMPHASIS 





Year 


Major 
Problem 

% 


Minor 
Problem 

% 


Not A 
Problem 
7 


Teacher dissatisfaction with 
project objectives 


1978 


8 


36 


52 


1979 


12 


18 


65 


Conflict between project objectives and 
other district objectives 


1978 




24 


72 


1979 


6 


29 


59 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 


8 


32 


56 


1979 


6 


24 


59 


Conflict between teachers and reading 
specialists 


1978 


12 


44 


36 


1979 




35 


59 



School: COMPARISON 





Year 


Major 
Problem 

% 


Minor 
Problem 

% 


Not A 
Problem 

% 


Teacher resentment of administering 
tests to students not benefiting 
from the project 


1978 


43 


10 


29 


1979 




22 


56 


Teacher resentment of extra work without 
receiving new materials or other support 


1978 


43 


10 


24 


1979 


6 


39 


i7 


Parental compl£ilnts about 
testing 


1978 




10 


52 


1979 




11 


72 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 


10 


5 


57 


1979 


6 


11 


67 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.16 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADE 3 
Site: MICHIGAN 
Year: 1978 







Yes 
Z 


Some- 
times 
% 


no 


Reading Is fun 


SDecial 
Emphasis 


67 


28 


5 


Comparison 


46 


48 


1 


I like to read during 
my free time 


SoeciaX " 
Emphasis 


70 


28 


2 


Comparison 


70 


23 


2 


I like my reading class 


Special 
Emphasis 


78 


17 


5 


Comparison 


62 


30 


3 


I read only when 
I have, to 


Special 
Emphasis 


49 


29 


21 


Conmarlson 


21 


19 


56 


Year: 1979 








School 


Yes 

% 


Some- 
times 

% 


No 

% 


Reading Is fun 


Special 
Emphasis 


75 


16 


3 


Comparison 


79 


20 


1 


I like to read during 
vay free time 


Special 
Emphasis 


44 


38 


11 


Comparison 


48 


39 


13 


I like my reading class 


Special 
Emphasis 


59 


25 


10 




Comparison 


79 


16 


5 


I read only when 


Special 
Emphasis 


46 


23 


25 


I have to 


Comparison 


19 


27 


54 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.17 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADES 4-6* 
Site: MICHIGAN 
Year: 1978 



Reading Attitudes 


School 


Yes 

/o 


Some- 
Times 


No 

% 


Do you like to read? 


Special 
Emphasis 


58 


41 


1 


Comparison 


65 


33 


0 


Do you read better this year 
than last year? 


Special 
Emphasis 


78 


13 


7 


Comparison 


82 


11 


4 


Reading Habits 


School 


0 
% 


1-5 

% 


6+ 
% 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


18 


61 


20 


Comparison 


23 


61 


12 


How many books have you 
read during the past month? 


Special 
Emphasis 


7 


29 


63 


Comparison 


5 


39 - 


52 


Year: 1979 




Reading Attitudes 


School 


Yes 

% 


Some- 
Tlmes 

% 


No 
Z 


Do you like to read? 


Special 
Emphasis 


53 


44 


2 


Comparison 


51 


43 


2 


Do you read better this year 
than last year? 


Special 
Emphasis 


89 




10 


Comparison 


91 




4 


Reading Habits 


School 


0 
% 


1-5 

% 


6+ 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


19 


66 


15 


Comparison 


22 


. 62 


11 


How many books have you 
read during the past month? 


Special 
Emphasis 


5 


27 


67 


Comparison 


9 


38 


46 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. . 



TABLE 5.18 
SUMMARY OF PARENT SURVEY* 

Site: MICHIGAN 
Year: 1978 





School 


Yes 

z 


No 

z 


Canno t 
Say 
% 


Does your child share books 
wxLxi jfuu or yout raniixyi 


Special 
Entphasls 


81 


14 


4 


Comparison 


82 


14 


3 


Does the school set up 
parent/ teacher conferences? 


Special 
Emphasis 


81 


14 


4 


Comparison 


77 


14 


7 


Have you worked as a 
volunteer in your child's 
school this year? 


Special 
Emphasis 


12 


76 


1 


Comparison 


7 


75 


1 



Year: 1979 





School 


Yes 

% 


No 

% 


Cannot 
Say 

% 


Does your child share books 
with you or your family? 


Special 
Emphasis 


86 


7 


5 


Comparison 


88 


6 


3 


Does the school set up 
parent/teacher conferences? 


Special 
Emphasis 


89 


4 


6 


Comparison 


82 


9 


7 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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OHIO 



Summary 



Th6 ANCOVA performed for the Ohio project showed virtually no 
significant differences during project year 1977-78. The one exception 
was in ^avor of the Special Emphasis school in the analysis of students 
scoring below the mean on the pretest. Over the course of the 1977-78 
project year, however, a smaller percentage of students in the compari- 
son school than the Special Emphasis school fell 1 or more years below 
grade level in reading. As previously discussed in Section 4, the Ohio 
project was not evaluated for the 1978—79 project year. 

Comparison school teachers reported slightly more positive atti- 
tudinal and behavioral changes with respect to reading than did the 
treatment school teachers. Resentment regarding participation in the 
Special Emphasis evaluation was high among comparison school teachers. 
In spite of LEA problems which plagued the project throughout its imple- 
mentation, the instructional model used in Special Emphasis is now 
being maintained for use in other district schools. 

The following subsections present a review of project outcomes 
at the Ohio site. 

Covariance Analysis of "Whole Grade" Cohort Groups 

The sunmiary of the ANCOVA for each grade in the Special Emphasis 
and comparison schools in Ohio is contained in Table 5.19, ANCOVA Impact 
Summary. As shown by this table, there were no statistically signifi- 
cant differences in project year 1977-78 for the '"whole grade" cohort 
groups . 

Covariance Analysis of "Below Mean" Cohort Groups 

For the "below mean" ANCOVA, a significant difference was evident 
only at grade 6 in which the adjusted mean posttest scaled score for 
the Special Emphasis group exceeded the score f \ r the comparison school 
group. The average observed change in grade equivalent was 1.6 years 
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TABLE 5.19 
ANCOVA IMPACT SUMMARY 



Sllc: tilllii 





P 


iioiicTYFiR 
i?;h??8 








.. 


HilOLE GRADE 

'imnm 

lD/8-19?!! 




Inllial 
Vear,. 


Sclinol 


Sig. 
of 

J_ 


Direction 

of 
kliact 


Change 
in 




tirade 
Initial 


ScllDOl 


Slg. 
of 
F 


Direction 
of 

loipact 


dmnge 
in 

Gr^_E(iiilv. 


2 


S.E. 
C. 


H.S. 


- 


+0.6 
+0.6 




2 


S.E. 
C. 


N/A 


3 


S.E. 
C. 


N.S. 


- 


+1.2 
H.k 




3 


S.E. 

C. 


N/A 






4 


S.E. 
C. 


N.S. 




+0.5 






S.E. 
C. 


N/A 






5 


S.E. 
C. 


N.S. 




-0,2 
-0... 




5 


S.E. 
C. 


N/A 






6 


S.E. 
C. 


N.S, 




+1.6 
+1.4 




6 


S.E. 
C. 


N/A 









n 


CrnJe 
Initial 
Year 


School 


2 


S.E. 

If 


3 


S.E. 
C. 


k 


S.E. 
C. 


5 


S.E. 
C. 


6 


S.E. 
C. 



mi-m 



Slg. 
of 

J... 

N/A 



N/A 

N/A 



N/A 



N/A 



Direction 

of 
Jiiil)act 



in 

Gr.Ji[ulv. 



..J 
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Em ciiADE 'm 



mm year' 

_ .157M!I78 



Craile 
Initial 
Year 


School 


Slg. 
of 
F 


Direction 

of 
Impact 


2 


S.E. 

C. 


N.S. 










3 


S.E. 

,c. 


N.S. 




k 


S.E. 
C. 


N.S. 




5 


S.E. 

C. 


N.S. 




6 


S,E. 
C. 


M 


S.li, 











Change 
In 
Gr. E(i 



^0.6 
■10.5 



+1.0 

+0.2 
+0.1 

-OJ 
+0.2 



Ml. II 



Grade 

Initial 

Year 



2 



Schnol 



S.E. 
C. 

S.E. 
C. 

S.E. 
C. 

S.E. 
C. 

S.E, 
C. 



EOT YEAR 

1978-]9j9 

Direction 

of 
Impact 



Slg. 
of 
F 



N/A 
N/A 
N/A 

N/A 
N/A 



Qiange 
In 
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for the Special Emphasis "below mean" group and 0.6 for comparison "below 
mean" group. The relatively small sample of "below mean" students (refer 
to Appendix F) at this grade should, however, be noted. 

Trend Analysis of Students Reading 1 or More Years Below Grade Level 

Because the Ohio site did not participate in the study after 1977-78 
a multi-year trend analysis is not possible. Table 5.20 illustrates 
the percentages of students at each grade who were reading 1 or more 
years below level in 1977-78. 



TABLE 5.20 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



Sit«: OHIO 



Grade 



.J, 
J, 
J. 
-6. 



Treatment School 



Sprins 


Spring 


Spring 


1977 


1978 


1979 


Z 




m 


18 


N/A 


N/A 


29 


N/A 




3A 


N/A 


./A 


43 


. N/A 


N/A 


40 


. N/A 


N/A 



Comperison School 



Spring 
. 1977 



Spring 
1978 



Spring 
1979 



School Total 



27 



N/A 



N/A 




32 



N/A 



N/A 



During project year 1977-78, the percentage of students in the 
comparison school reading 1 or more years below grade level at the 
beginning and end of the project year did not increase at the same 
rate as in the Special Emphasis school. As Table 5.21 shows, only 
5% more of the comparison school students read 1 or more years below 
level, from 28% to 33%, that year compared with 14%, from 23% to 37%, 
of the treatment school students. The bulk of this increase occurred 
at the grade 5 level (refer to Table D.7 in Appendix D) . 
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TABLE 5.21 

NUMBER OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



sice: OHIO 





1 Treatment School ^raoarison School! 


1 Project Year , Proiect Year 


local scudeacs cesced ac 
boch points* 


1977-78 1973-79 
175 N/A 


i 1977-73 19 73-79} 
145 N/A 




i 


3e«irmin« of Proiecc Ytar 


40 N/A 


40 N/A i 


2. N^o. students casce'* > 1 year 
below grader 

"5 Z of cocal 3r!irf*>nrQ 

(line 2/ line 1) 


! 1 

232 N/A 1 28% N/A ' 


! 1 


End of Proiect Year 


65 N/A 


I 
1 

t 
! 
1 

48 N/A ' 


4. .Vo. students tested > 1 year 
below grades 

5. ^ of total students 
(line 4/line 1) 


37Z N/A 


1 
1 

33X N/A 1 


1 1 



* 

Spring 19 77 and spring 1978 for 1977-78 
Spring 1978 and spring 19 79 for 19 78-79 

Spring 1977 for 1977-78 and spring 1978 for 1978-79 

Sprlag 1978 for 1977-78 and spring 1979 for 1978-79 



Attitudlnal and Behgyloral Findings 

Because the Special Emphasis evaluacioxi was not continued during 
1978-79 in Ohio, no observations ragarding attitudinal and behavioral 
changes can be made. Based upon the data collected in 1978 several 
comments can be made* 

• Comparison school teachers were more positive regarding 
reading attitudes and behaviors than Special Emphasis 
school teachers. (Tables 5.22 and 5.23) 

• Comparison school teachers expressed resentment over their 
involvement in the Special Emphasis Project. (Table 5.24) 
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• Special Emphasis school teachers expressed concern that 

reading was being emphasized at the expense of other program 
areas. (Table 5.24) 

Residual Effects of Special Emphasis 

In spite of its problems in implementing and sustaining Special 
Emphasis, the Ohio site managed to derive permanent benefits from the 
project. The language experience approach to reading instruction, 
which was the philosophical core of their Special Emphasis model, is 
being implemented at the new magnet schools designed to be a positive 
force in the district's desegregation efforts. It seems evident that 
an underlying factor in this carry over was the district's intention, 
from the outset of the prolect . to replicate the model piloted in 
Special Emphasis. 
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TABLE 5.22 
TEACHERS' ASSESSMENTS OF ATTITUDES* 



Sice: OHIO 



School: SPECIAL SCPHASIS 



jXeachers^^ " — ■ — 
Asaassnenc of: ^ 


Effecc 


Positive 
Change 
X 


No 
Change 


Negacive 
Changs 
X 


I Canaoc 
; Tell 


No 

Response 


jScudencs' acclcudes 
iCovard reading 


j 1978 


70 


30 i - i - : 


. 1979 












iTeachers' actitudes coward ! 1973 


60 


30 




10 






j 1979 


1 


- 


- 






jPriacipals* accicudes 


1 1978 


30 1 


20 




50 ; 




1 Coward reading program 


! 1979 


- ! - ! - 1 - 1 - 



School : COMPARISON 



Teachers ' ^ 

Assesssenc of: " 


ffecc 
— _ 


Posiclve 
Change 
X 


i :^o 

; ChJ^nge 
1 X 


; Negaclve 
Change 

'« 


\ Cannoc ; No 
Tell ^ ?^s?onse 

' * i if 


iScudencs ' accicudes 
i Coward reading 


! 1978 1 


100 


1 - 




: - ! 


1 1979 i 




- 




i 


^teachers' acclcudej coward 
reading inscruccion 


I 1973 1 


36 


— 




! 14 


1 1979 i 


— 


- 






Principals' accicudes 
'coward reading progr&a 


j 1978 : 




14 




29 


I 1979 i 


- 









Non-response or rounding e^iCiaaces are responsible for row cocals below or above 
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TABLE 5.23 

TEACHERS' ASSESSMENTS OF STUDENT READING BEHAVIORS* 



Sie«: OHIO 



School: SPECIAL EMPHASIS 



T*«ch«r«' ^ Efface . 

AtsMratnt o£ 

Seudaae Kaadlng B«havlor« 


Poaleiva 
Chaat« 

X 


No 
Chaaga 

X 


Kagaciva 
Chaaga 

X 


Caxmoc 
taU 


No 

Saaponaa 

« 


Tim aptnc raadlag 
In elaaa 


1978 


60 


30 






10 


1979 












Tim apaac raadlng 
outsida of elaaa 


1978 


20 1 20 






60 


1979 












Library aad/or 
eXaaarooat book uaaga 


1978 


60 


30 






10 


1979 













School: COMPARISOH 



Taachara' "--..^..^ Efface 
Aaaaaaaanc of 

SCodanc Baadlag Bahavlora ^ 


Poaltlva 
Ctaaage 

X 


No 
Chaaga 

X 


Nagaclva 
Chaaga 

X 


CUBOC 

Tall 

X 


No 

Baapoaaa 

X 


Tim apaac raadiag 


1978 


86 


. 1 . 




14 


la elaaa 


1979 












Tim apaac raadiag 


tf78. 


72 


14 






14 


oncalda of claaa 


1979 






- 1 - 




Library and/or 


1978 


72 


14 






14 


daaaroofe book uaaga 


1979 




- 1 - 


1 - 



Hott-xaspoaaa or rouadlag aatloMieas ara raapoaalbia for row cocala balov or abova 

lOOZ. 



5-35 

195 



TABLE 5. 24 

TEACHER CONCERNS RESULTING FROM SPECIAL EMPHASIS INVOLVEMENT* 
Site: OHIO 
School: SPECIAL EMPHASIS 





Year 


Maj or 
Problem 
Z 


Minor 
Problem 

z 


Not A 
Problem 

z 


Teacher dissatisfaction with 
project objectives 


1978 




10 


70 


1979 








Conflict between project objectives and 
other district objectives 


1978 






80 


1979 








Teacher feelings that reading is 
emphasized at expense of other programs 

w 


1978 


10 


40 


40 


1979 








Conflict between teachers £.<id reading 
specialists 


1978 






90 


1979 









School: COMPAEISON 





Year 


Maj or 
Problem 
Z 


Minor 
Problem 
Z 


Not A 
Problem 
2 


Teacher resentment of administering 
tests to students not benefiting 
from the project 


1978 


57 


14 


29 


1979 








Teacher resentoent of e^tra work, without 
receiving new materials or other support 


1978 


86 


14 




1979 








Parental complaints about 


1978 




29 


71 


testing 


1979 








Teacher feelings that reading is 
emphasized at expense of other programs 


1978 






10 


1979 









Non-response or rounding estimates are responsible for row totals below 
or above 100%. 



TENNESSEE 



Summary 

The ANCOVA indicated no significant differences for the Tennessee 
site in project years 1977-78 and 1978-79 or for the period of 1977-79. 
The comparison school did experience a net reduction of students reading 
1 or more years below level in 1977-78~one of only two such instances 
observed in the Special Emphasis Project study sites. Apparent improve- 
ment in both schools in the percentages of students reading 1 or more 
years below level over the course of the study seems to be heavily 
influenced by the exit of low achieving cohort groups and individuals 
from the observed sample (e.g., sixth graders). This phenomenon merits 
closer scrutiny. 

Approximately half of the teachers in the treatment school thought 
that reading may have been emphasized at the expense of other subjects. 
These reservations notwithstanding, the Special Emphasis school teachers 
identified a wide variety of reading instruction practices which they 
acquired during the Special Emphasis Project and which they will continue 
to use in their teaching. Thus, while the impact of Special Emphasis, 
based on tests of statistical significance on the SDRT results, were 
inconclusive, the residual institutional benefits in the Tennessee site 
are quite clear. 

The following subsections describe in detail the project outcomes 
for Tennessee. 

Covariance Analysis of "Whole Grade" Cohort Groups 

A summary of the ANCOVA for each grade in the Special Emphasis 
coB?)arison schools is contained in Table 5.25, ANCOVA Itijpact Summary. 
There were no significant differences in the adjusted posttest scaled 
scores for project years 1977-78 and 1978-79 nor for the total period 
1977-79 for the "whole grade" cohort groups. 
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TABLE 5.25 
ANCOVA IMPACT SUMMARY 



Site; imnm 



PROJECT YEAR 

m-im 



Crade 

Initial 

Year 



2 



School 



s.e. 
c. 

S.E. 

c. 

S.E. 
C. 

S.E. 
C. 

S.B. 
C. 



Slg. 
of 
F 



N.S. 



N.S. 



ti.S. 



N.S, 



N.S, 



Direction 

of 
linpact 



Change 
In 

Gr. Equlv. 



40.; 
«.? 

+1.3 
+1.4 

+0.7 
+1.4 



+0.5 
+0.8 

+0.9 
+1.1 



UIIOLE GRADE 



FROJECT YEAR 
197B-1979 



Grade 

Initial 

Year 



2 



School 



S.E. 
C. 

S.!- 
C. 

S.E. 
C. 

S.E. 

C. 

S.E. 
C. 



Sig. 
of 
1 



N.S. 
N.S. 
N.S. 

N.S. 
N.S. 



Direction 

of 
Impact 



In 

Gr. Eqylv. 



+0.8 
+0.8 

+1.0 
+1.3 

+0.9 
+1.1 

+o'.i 

+0.6 

+1.1 
+1.8 



PROJECT YEARS 



1977- 



Grade 
Initial 
Year 



2 



School 



S.E. 
C. 

S.E. 
C. 

S.B. 
C. 

SfEi 



S.E. 
C. 



Sig. 
of 
F 



N/A 



N.S. 



N.S. 



979 



Direction 
of 

Impact 



N.S. 



in 

jr. E quiv. 



+1.7 
+2.0 

+2.2 
+2.3 

iO.7 
+2.0 

+1.7 
+2.4 
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BELOH GRADE NEAN 


PROJECT YEAR 
1977-1978 




PROJECT YEAR 
1978-1979 


Grade 

Initial 

Year 


School 


Sig. 
of 
F 


Direction 

of 
Inpact 


Change 
in 

Gr. Equlv. 




Grade 

Initial 

Year 


School 


Sig. 
of 
t 


Direction 

of 
Inpact 


Change 
In 

Gr. Equlv. 


2 


S.E. 
C. 


N.S. 




+0.8 
+0.9 




2 


S.E. 
C. 


N.S. 


m 


+^.9 
+0.9 


3 


S.E. 

c. 


N.S. 




+0.9 
+1.3 




3 


S.E. 
C. 


N.S. 




+0.9 
+1.2 


4 


S.E. 
C. 


N.S, 




+0.6 
+1.3 




4 


S.E. 
C. 


N.S. 




+0.7 
+0.9 


5 


S.E. 

C. 


N.S. 




+0.4 
+0.7 




5 


S.E. 
C. 


N.S. 




+0.1 
+0.5 


6 


S.E. 
C. 


N.S. 




+0.6 
+1.0 




6 


S.E. 
C. 


N.S. 




+1.0 
+1.1 
- 



Covarlar xe Analysis of "Below Mean" Cohort Groups 

For project years 1977-78 and 1978-79 there were no significant 
differences in the adjusted posttest scaled scores in the analysis of 
the "below mean" cohort group. 

Trend Analysis of S tudents Reading 1 or More Years Below Grade Level 

Table 5.26, Trend Analysis of Students Reading 1 or More Years 
Below Grade Level, combines data from Tables D*8 to D.IO in Appendix D 
to provide a trend analysis of the percentage of students reading 1 or 
more years below grade level in 1977, 1978, and 1979. 



TABLE 5.26 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



Cradt 



Spring 

X977 



Spring 

1978 



Spring 

X979 



Spring 

1977 



Compariaon SchQ9l 



Spring 

1978 



Spring 
1979 







. 3-. 

J«. 

-6-. 




School Tocnl 



45 



37 



20 




Both the treatment and comparison schools had a drop from 1977 
to 1979 in the percentage of students reading 1 or mora years below 
grade level; for the Special Emphasis school, from 45Z to 20%, and, 
for the comparison school, from 34Z to 20%. By referring to Table 
D.8 in Appendix D, it can be shown that the drop in the percentage of 
students reading 1 or more years below grade level from 31% to 20%, 
between grade 2 studen^J in Spring 1977 and grade 3 students in spring 
1978 is due to the exit of low achieving students and not the improve- 
ment during the 1977-78 project year of students ^o were reading 1 
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or more years below grade level at the beginning of the project year. 
This same conclusion applies to the other instances where a drop occurred 
in the percentage of students reading 1 or more years below grade level. 

It is evident from Table 5,26 that second grade students in the 
treatment school are testing better each successive year; few comparison 
school second graders scored 1 or more years below grade level at any 
testing Point. 

Table 5.27, Numbers of Students Reading 1 or More Years Below 
Grade Level, shows that, for students tested both at the beginning and 
end of each project year, the treatment school had an increase in the 
percentage of students reading 1 or more years below grade level of 
8% from 393: to 47% in 1977-78, and 1%, from 25% to 27% in 1978-79. Th^ 
comparison school hail a net decrease of 2%, from 26% tc \X in 1977-78 
and an increase of 8%, from 13% .^o 23% in 1978-79. 

Attitudinal and Behavioral FindinRc 

Data were collected in 1978 cind 1979 from teachers, students, 
and parents regarding reading attitudes and behaviors, A summary of 
find ings by the various respondent groups are presented below. 

Teachers 

• At the Special Emphasis school, improvement in student 
reading attitudes and behaviors and in teachers and the 
principal's attitudes were reported in both 1978 and 1979. 
(Tables 5.28 and 5.29) 

• At the comparison school, student attitudes and behaviors 
and teachers attitudes improved in 1973 and 1979. (Tables 
5.28 and 5.29) 

• At the comparison school, following the assignment of a 
new principal in 1978, teachers reported an improvement in 
the principal's attitude toward reading. (Table 5.28) 
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TABLE 5.27 

NUMBERS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 
Slc«: TEMNESSEE 



I Treacaenc School ; Comparison School l 



1 

f 

boch polncs* 


• Projecc Year 
19/7-78 1973-79 

199 160 


I Proiecc Year 
' 19-7-73 1978-79) 

1 

100 105 

1 


3€«innin« oc Project Year 

2. No. scudencs cesced > I year 
below grader 

3. Z of cocal scudencs 

(line 2/ line 1) 


78 40 
39Z 25Z 


26 16 

} 
j 

262 15Z 1 


End of Proiecc Tear 

^. 1^0. scudencs cesced > 1 year 
below grade! 

5. Z of cocal scxidencs 
(Une A/line 1) 


94 43 

27Z^ 


24 24 
242 232 



* 

Spring 1977 and. spring 1978 for 1977-78 
^Spring 1978 and spring 1979 sor 1978-79 
_3pring 1977 for 1977-78 and spring 1978 for 1978-79 

Spring 1978 for 1977-78 nnd spring 1979 for 1978-79 



• At the Special Emphasis school teachers felt that reading 
was being emphasized at the expense of other program 
areas in 1978 and 1979. (Table 5.30) 

• At the comp.'irison school in 1978 teachers expressed 
resentment over the extra work project participation 
imposed, in 1979 no teacher expressed objection. (Table 5.30) 

Students and Parents 

• At the Special Emphasis and comparison schools, third 
graders reveal disparate reading attitudes and behaviors in 
the majority of areas probed in 1978 and 1979. (Table 5.31) 
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TABLE 5.28 
TEACHERS' ASSESSMENTS OF ATTITUDES 



Slc«: 'rKMNKtiSEg 



School: SttCUL BKPBASIS 



Aa«M3flMxic of: "" --.-......^ 


Posltlvo 
Z 


No 
t 


ChangA 

X 


I Cazmoc 
Tail 

L X 


Ho 

Rasponsa 

X . 




1978 


ICO 










covard raadlng 


1979 


82 


9 


9 






TaaciMrs' acticiid«« coward 


1978 


86 


14 








rMdlas iascruccion 


1979 


91 






9 




PriaeipAls' accXcudaa 
tovard nadlnf progra 


1978 


86 








14 


1979 


82 




18 





School: CCMPA2IS0N 



' ■ Efface 

iXaaehara ' ^■^^-i.-.i.....,^^^^^ 
jAuaaamnt; of: * 


Poalclva 
Changa 

X 


Ho 
Changa 

X 


Nagadva 
Changa 

X 


Cannot 
TaU 
X 


No 

Saaponaa 

X 


Studants' acclctidaa 
jcovard raadlng 

1 


1978 


100 










_ 1979 


100 










taaehara' auzlcudaa coward 
raadi&g inacrucdon 


-;978 


73 


27 






1979 


100 


- 1 




- 1 - 


Principals' actltudaa 
covard raadlng prograa 


1978 


27 


45 1 




27 


_ 1979 


67 


22 t 




u 1 . 



* 

^raaponaa or rounding aatlabcaa ara raapooalbla for row tocala balov or abova 

xooz* 
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:TAELE 5.29 

TEACHERS' ASSESSMEIJTS OF STUDENT RE/iDING BEHAVIORS* 



Sic*: TZHHESSEE 



School: S7ECXAI. sMFEASIS 



T*Ach*rs' ^"^^ — ^ E££*cc 
AtsMraanc of ^^"^^-..^ 
Studtac aaadlng B^vlort — ^ 


Poctcivtt 
Change 


Ho 
Ch«nga 

: 


Negaciva 
Cha&ga 

X 


Cancoe 
Tail 

X 


No 

Hacponaa 
X 


Tlaft 9pmat reading 
in tiXaMM 


1978 


93 


7 








1979 


82 


9 




9 




tlM tptti: rftadiag 
oucsidtt of elus 


1978 


57 


36 






7 


1979 


64 






36 




Llbrarr mad/or 
clASSrooa >ook uaagt 


1978 


79 


21 








1979 


73 


9 




18 





School: COMPARISON 



Taachara' — , ^ Efface 

Aaaaaananc of 

Scudanc Raadinc Bahavlora ^ 


Poaiciva 
Changa 

X 


No 
Chenga 
X 


Nag«civa 
Changa 

X 


Cannoc 
TaU 

: 


No 

Raapoaaa 
• 


Xiaa apanc raadiag 


1978 


73 


27- 


- 


- 


- 


in claaa 


1979 


100 


- 


- 


- 


- 


Tiaft apenc raadisg 


1978 


45 


27 


- 


27 


- 


Ottcsida of elAsa 


1979 


44 




- 


56 


- 


LibraiT and/or 
daaarooa book uaaga 


IS 78 


91 


9 


_ 




1979 


100 


- 


- 







Non-raaponaa or rounding ascioacaa ara raaponaibla for rov eocalii balov or abova 



TABLE 5.30 

TEACHER CONCERNS RESULTING ?ROM SPECIAL EMPHASIS INVOLVEMENT* 
Site: TENNESSEE 
School: SPECIAL EMPilASIS 





Year 


Major 
Problem 


Minor 
Problem 

7 
A 


Not A 
Problem 

% 


Teacher dissatisfaction with 
project objectives 


1978 






93 


1979 




18 


82 


Conflict between project objectives and 
other district objectives 


1978 




14 


79 


1979 




27 


73 


Teacher feelings that reading Is 
emphasized at expense of other programs 


1978 




50 


43 


1979 


9 


27 


64 


Conflict between teachers and reading 
specialists 


1978 




14 


79 


1979 




18 


82 



School : COMPARISON 





Tear 


Major 
Problem 
% 


Minor 
Problem 
Z 


Not A 
Problem 
% 


Teacher resentment of administering 
tests to students not benefiting 
from the project 


1978 


9 


9 


73 


1979 






100 


Teacher resentment of extra work without 
receiving new materials or other support 


1978 


9 


36 


45 


1979 






100 


Parental complaints about 
testing 


1978 






91 


1979 






■100 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 




27 


64 


1979 




11 


89 



it 

Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.31 

STUDENT ATTITUISS AND BEHAVIORS REGARDING READING - GRADE 3* 
Site: TENNESSEE 
Year: 1978 





dcnool 


1 es 

z 


Some- 
times 
X 


No 
S 


Re&dlng is ftm 


Sd&^I ill 

Emphasis 


40 


52 


7 


Comparison 


52 


31 


9 


I like to read during 
my free time 


Emphasis 


71 


15 


10 


Comparison 


57 


31 


5 


I- like my reading class 


Special 
Emphasis 


60 


22 


15 


Comparison 


64 


19 


9 


I read only when 
I have to 


Special 
Emphasis 


50 


15 


33 


Comparison 


38 


19 


33 



Year: 1979 





1 School 


Yes 

z 


Some- 
times 


No 

z 


Reading Is fun 


Special 
Emphasis 


80 


16 


2 


Comparison 


56 


34 


3 


I like to reed during 
my free time 


Special - • 
Emphasis 


44 


42 


13 


_ Comparison 


53 


34 


6 


I like tnjr reading class 


'Special 
Emphasis 


64 


31 


4 


Comparison 


66 


12 


16 


I read only when 


Special 
Emphasis 


34 


24 


38 


I have to 


Comparison 


41 


22 


31 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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• At the Special Emphasis and comparison schools, students 
In the fourth, fifth, and sixth grades revealed nearly 
identical reading attitudes and behaviors in 1978 and 1979. 
(Table 5.32) 

• The Special Emphasis and comparison schools parent data for 
1978 and 1979 show little difference between the two groups. 
(Table 5.33) 

Residual Effects of Special Emphasis 

No site has experienced the degree of residual experience 
on the district, project school, staff, and families as has the Tennessee 
site. Not only have teachers and administrators seen scores improving 
on district-administered reading achievement tests, but everyone involved 
in the project felt that their approach to Special Emphasis 'Vorked," 
i.e., the strategies devised for Special Emphasis were a better way of 
teaching than those they had employed in the past. According to the 
Assistant Superintendent for Instruction, the district will be looking 
for ways to apply project features — either with district funds or with 
outside funding. Evcu without further initiatives, he felt that there are 
definite residual effects: teachers have been trained in reading 
instruction, and they will apply their skills for years to come; and 
students and parents have been motivated to develop keen interest in 
reading and will influence other siblings. 

lu the view of the reading supervisor. Special Emphasis was imple- 
mented in a situation where Title I and ESAA hadn't made any impact in 
achievement levels — in fact, the situation was getting worse. By 
putting the reading specialists into the classroom with teachers, both 
children and teachers learned new skills. In areas such as technical 
decisions on student grouping and choosing appropriate materials to 
suit individual student needs and in routine matters such as space 
arrangement in the classroom, the teachers assimilated new approaches 
from the collegial interchange with the reading specialists. As a 
result, LEA officials feel that the classroom teachers are now in 
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TABLE 5.32 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADES 4-6 * 
Site: TENNESSEE 
Year: 1978 



Reading Attitudes 


1 

School 


Yes 
% 


Some- 
Tines 
% 


No 
X 


Do you like to read? 


Special 
Emphasis 


57 


42 


1 


ContDarlson 


55 


41 


1 


Do you read better this year 
than last year? 


Special 
Emphasis 


78 


17 


4 


Comjjarison 


68 


17 


11 


Reading Habits 


School 


0 
% 


1-5 
% 


6+ 
Z 


How many hours do you spend 
reading outside of school 
per week? 


Special 
_&Bphasi3 


17 


62 


21 


Comparison 


20 


63 


12 


How many books have you 
read during the past ncnth? 


Special 
Emphas is 


2 


29 


67 


Comparison 


3 


41 


52 



Year: 1979 



Reading Attitudes 


School 


Yes 
Z 


Some- 
Times 
% 


No 
Z 


Do you like to read? 


Special 
Emphasis 


46 


50 


2 


Comparison 


55 


42 


3 


Do you read better this year 
than last year? 


Special 
Emphasis 


89 




9 


Comparison 


96 




4 


Reading Habits 


School 


0 
% 


1-5 

Z 


6+ 

% 


How :^ny hours do you spend 
reading outside of school 
per week? 


Special 
^Emphasis 


24 


63 


11 


Comparison 


20 


72 


8 


How many books have you 
read during the past month? 


Special 
Emphasis 


5 


44 


49 


Comparison 


6 


29 


64 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.33 
SUMMARY OF PARENT SURVEY 



Site: TENNESSEE 
Year: 1978 





School 


Yes 
Z 


No 
Z 


Cannot 
Say 

z 


Does 'VOUr chj.!Ld shflY*^ hnrkka 

with you or your family? 


Special 
Emphasis 


80 


16 


4 


Comparison 


75 


18 


4 


Does the school set up 
parent /teacher conferences?- 


Special 
Emphasis 


46 


37 


14 


Comparison 


37 


50 


7 


Have you worked as a 
volunteer In your child's 
school this year? 


Special 
Enphasis 


13 


74 


1 


Comparison 


6 


76 


2 



Year: 1979 





School 


Yes 
Z 


No 
Z 


Cannot 
Say 

Z 


Does your child share books 
with you or your family? 


Special 
Emphasis 


81 


11 


6 


Comparison 


86 


•0 




Does -the- school set-up 
parent/ teacher conferences? 


Special 
Emphasis 


58 


25 


J.? 


Comparison 


50 


33 


14 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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a better position to make decisions on what the students need. The 
experiment of putting the reading specialists into the classrooms with 
teachers, she feels, has had the greatest impact on students and teachers. 
Thus^ she sees that the district can go a lot further than it has in 
the past in its utilization of specialists. 

Originally 9 the school district was negative about attempting 
change "from the top down." Through the Special Emphasis experience 
they have learned that classroom teachers are looking for support. They 
now recognize that by providing resources and models, change can be 
initiated. Without this aspect of Special Emphasis, she feels the 
school would not be able to sustain the impetus once the Title VII 
funding ended. 

From the experimental principal's perspective, both the students 
and the teachers have gained. Through staff development, the teachers 
have learned to use assessment in program planning and implementation. 
Parent involvement was not anticipated to the extent that it occurred. 
(Among the spin-off effects: 16 parents participated in a General 
Education Development (GED) class taught by a reading specialist; thus 
far, 7 parents have been awarded their GED.) After Special Emphasis 
funding expired^ the principal designated the two reading specialists 
in his school as resource persons and reading materials coordinators, 
and the teachers continued to use these resources. Teachers report s*. 
better understanding and greater use of student grouping, diagnostic 
assessment, matching materials with students, and handling several 
groups within the classroom. While only 45% of the teachers pr»^dicted 
carry-over effects, 91% were able to cite specific, tangible benefits 
from Special Emphasis. 
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TEXAS 
Siupffiary 

The ANCOVA for the "whole grade'' and ''below mean" cohort groups 
in Texas showed scattered instances of significant differences between 
the Special Emphasis and comparison groups • In each of these instances, 
the adjusted posttest scaled scores for the Special Emphasis group 
exceeded that of the comparison group. These were statistically 
significant differences in adjusted posttest scores for both project 
years for the grade 2 "below mean" groups. The treatment and comparison 
schools experienced no overall change in the percentage of students 
reading 1 or more years below grade level over the 1977-79 period. 

No obvious differences appeared with respect to perceptions of 
reading attitudes between the Special Emphasis and comparison schools. 
The school district's favorable experience with Special Emphasis has 
influenced policies and procedures relating to reading programs within 
the district, and several other residual effects from the project were 
noted as well. 

The following subsections describe in detail the project outcomes 
for Texas. 

Covariance Analysis of "Whole Grade" Cohort Groups 

The summary of the ANCOVA for each grade in the Special Emphasis 
and comparison schools is contained in Table 5.34, ANCOVA Impact 
Summary. In project year 1977-78, a statistically significant difference 
in the adjusted posttest scaled scores was identified for grade 2. 
In this instance, the score for the Special Emphasis group exceeded 
that of the comparison group. The average observed eh:^nge in grade 
equivalent for the Special Emphasis group was 0.7 vs. 0.5 for the 
comparison group. The presence of ceiling effects In the posttest 
scores of each group result In an underestimation of the true change 
in grade equivalent. 
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TABLE 5.34 
ANCOVA IMPACT SUMMARY 



I 

M 



Silc: Km 

















Slfll.E"(!RAI)r" 
















pimjEa VEAR 

19?7-19?8 








PROJECT YEAR 
1978-1979 








PROJECT 
1977- 


fBARS 
19?9 




Grnde 
InitUl 

Jfcnr _ 


SClKIOl 


SIg. 

01 


Direction 

of 
Impact 


Change 
In 

Gr. Equlv. 




Grade 
Initial 
_Year_ 


School 


Slg. 
of 

J _ 


Direction 

of 
_Inp,ict 


Change 
in 

Gr. Eqiilv. 




Grade 

initial 

Year 


Sdiool 


Sig. 
of 
F 


Direction 
of 

Impact 


Clinnge 
In 

^Gr. Bqiilv. 


2 


S.E. 
C. 






+0.7 
+0.5 




2 


S.E. 
C. 


<.01 


S.E. 


^^).5 
+0.4 




/ 


c. 


N|A 




3 


S.E. 

n 
li 


N.S. 




+1.1 
+1.4 




3 


S.E. 
C. 


n.3. 




+1.4 
+1.4 




PI 

3 


S.E. 
C. 


N.S. 





+1.9 


h 


S.E. 
C. 


N.S. 




+U.8 
+0.9 






S.E. 

C. 


N.S. 




+1.0 
+0.B 




4 


S.E. 
C. 


N.S. 


. — 


+2.1 
+2.2 


5 


S.E. 
C. 


N.S. 




+0.6 
+0.9 




5 


S.E. 
C. 


<.0l 


S.E. 


+1.7 
+0.6 




5 


S.E. 
C. 


<02 


S.K. 


+2.5 
+1.4 


5 


S.E. 
C. 


NM 








5 


S.E. 
C. 


N/A 








6 


S.E. 
C. 


N/A 
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tim GIIADE MEAN 










PROJEQ YF.AR 
1977-1978 




PROJSCT YFJiR 
1978-1979 


Grade 
Inltlfll 
Year 


School 


Slg. 
of 
F 


Direction 

of 
Impact 


Change 
In 

Gr.j(iMh, 




Grade 

Initial 

Year 


School 


Slg. 
of 
F 


Direction 

of 
Impact 


Clinnge 
In 

Gr. Equlv. 


2 


S.E. 
C. 


.04 


S.E. 


+0.7 
+0.5 




Z 


S.E. 
C. 


<.01 


S.E. 


+0.6 
+fl.4 


3 


S.E. 

c. 


N.S. 




+1.0 
+1.2 




3 


S.E, 
C. 


N.S. 




+1.1 
+1.2 


4 


S.E. 
C. 


N.S, 




+0.7 
10.9 




4 


S.E. 
C. 


N.S. 




^0.8 
+0.7 


5 


S.E. 

C. 


N.S. 




+0.8 
■KI.8 




5 


S.E, 
C. 


N.S. 




+1.2 
+0.3 


6 


S.E. 
C. 


N/A 









6 


S.E.' 
C. 


N/A 







For project year 1978-79, the ANCOVA revealed a statistically 
significant difference in the adjusted posttest scaled score favoring 
the Special Emphasis group for grade 5. The average observed change in 
grade equivalent was 1.7 years for the Special Emphasis group and 0-6 
for the comparison group. 

For the 1977-79 period, a statistically significant difference 
in adjusted posttest scaled scores was identified for the grade 5 
"whole grade" group completing grade 5 in spring 1979. This parellels 
the results of the grades ANCOVA for 1978-79. The observed change in 
grade equivalent was 2.5 years for the Special Emphasis group and 1.4 
years for the comparison group. It should be noted, however, that 
ceiling effects were present on the pretest, thus causing an overesti- 
mation of the true change. 

Covariance Analysis of "Below Mean" Cohort Groups 

For project year 1977-78, the ANCOVA indicated a significant 
difference in the adjusted posttest scores for grade 2 favoring the 
Special Emphasis "below mean" group. This finding replicates the 
results for the "whole grade" analysis for grade 2 in the same project 
year. The average. observed change in grade equivalent was identical 
to that for the "whole grade" group — 0.7 for Special Emphasis "below 
mean" group and 0.5 for the comparison "below mean" group. 

In project year 1978-79, the ANCOVA identified a statistically 
significant difference for grade 2 in mean adjusted posttest scores 
favoring the Special Emphasis group. In this case, the average observed 
change in grade equivalent was 0o6 for the Special Emphasis "below mean" 
group and 0.4 for the comparison "below mean" group. 
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Trend Anal ysis of Students Reading 1 or More Years Below Grade Level 
Table 5.35, Trend Analysis of Students Reading 1 or More Years 
Below Grade Level, combines data from Tables D.ll to D.13 In Appendix D 
to provide a trend analysis of the percentage of students reading 1 
or more years below grade level In 1977, 1978, and 1979. 



TABLE 5.35 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



Slt«: TEXAS 



TrtaoMnt School 



Sprint 

1977 



Spring 
1978 



Spring 
1979 



CoBParlJon School 
Spring Spring Spring 
1977 1975 1979 



J 

J 




School TocaI 



18 



18 



15 




17 



20 



16 



Table 5.35 shows that there was almost no change In the percentage 
of students reading 1 or more years below grade level for either school 
during the course of the study. There are no Instances where there are 
decrease In the percentage of students reading 1 or no re years below 
grade level following normal grade progression. 

Table 5.36, Number of Students Reading 1 or More Years Below 
Level, Illustrates that the rate at which students fall a year or 
more below level Is approxlmaf^ly the same for both Special Emphasis 
and the comparison school. In 1977-78, the percentage of students 
reading 1 or more ye. rs below grade level changed T:rom 7% to 16%, 
a 9% increasa ior the treatment school from the beginning to end 
of the project year; for the comparison school, the change was from 
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10% to 20%, a 10% increase. In 1978-79, the increase in the percentage 
of students reading 1 or more years below grade level for the treatment 
school was 10%, from 8% to 18%: for the comparison school, the increase 
was 8%, from 17% to 25%, 



TABLE 5.36 

NUMBER OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



Sic«: TEXAS 





Xreacsenc School 
Proiecc Year 


1 Comoarlson School) 


!• Vocal scudencs ceswftd ac 
boch points* 


1977-78 1978-79 
278 190 


Proiecc Vear 
1977-78 1973-79* 

1 

334 248 




1 
1 


3e?lnniQ? oz ?rojecc Yaar 

2. No. :3Cud!tncs casced > I /ear 
below griide'T 

3. X oi cocal scudencs 

(line 2/liue 1) 


19 16 


1 

34 42 ' 




i 

10% 17% i 






End oc Prolecc ?ear 

4. Xo. scudancs casced > I year 
balow gradai 

5. Z oi cocal scudencs 
(line 4/liae 1) 


44 35 


1 
t 

67 62 ! 


16% 18Z 


20% 25% 







* 

Spring 1977 and spring 1978 for 1977-78 
Spring 1978 and spring 1979 for 1978-79 

Spring 1977 for 1977-78 and spring 1978 f-ir 1978-79 

Spring 1978 for 1977-78 and spring 1979 for 1978-79 
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Findings 

Results of teacher, student, and parent surveys administered 
in 1978 and 1979 are outlined below. 

Teachers 

• From 1978 to 1979, student attitudes and behaviors and 
teacher and the principal's attitudes toward reading 
Improved at the Special Emphasis school. (Tables 5.37 and 
5.38) 

• From 1978 to 1979, student attitudes and behaviors showed 
positive change, however, change in 1979 is not as great 
as in 1978 at the comparison school. (Tables 5.37 and 
5.38) 

• From 1978 to 1979, fewer teacheis thought their colleagues' 
and the principal's attitudes toward reading showed improve- 
ment at the comparison school. (Table 5.37) 

• From 1978 to 1979, teacher concerns or problems resulting 
from project participation diminished at the Special 
Emphasis school. (Table 5.39) 

• From 1978 to 1979, teacher concerns resulting from project 
participation decreased at the comparison school, however, 
the majority of teachers remained dissatisfied with their 
role. (Table 5.39) 

Students and Parents 

• In 1978, grade 3 students at the Special Emphasis and 
comparison schools reflected similar reading attitudes 
and behaviors. (Tabxe 5.40) 

• In 1979, more Special Emphasis third graders reported that 
reading was fun than did comparison students. (Table 5.40) 
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• In 1978 and 1979, fourth, fifth, and sixth grade students 
show similar reading attitudes and behaviors at both 
schools, (Table 5, 41) 

• In 1978 and 1979, comparison school parents report a higher 
incidence of school-arranged parent-teacher conferences • 
(Table 5.42) 

Data from which these conclusions were drawn are contained in 
Tables 5.37-5.42. 

Residual Effects of Special Emphasis 

District officials felt that all the objectives of Special 
Emphasis had been inet. As a result of the Spct:Xal Emphasis experience, 
the district will demand more reading preparation for its new teachers 
and will 9^: guidelines for reading programs in primary grades. The 
skill mas ry ^record keeping system installed at the project school 
will be re r_. ;ed and replicated in other district schools. Special 
Emphasis to some extent, responsible for the district's decision 

to increase its reading budget over the past 3 years. School adminis- 
trators and staff felt that they have a better understanding of the role 
of reading in the curriculum and that reading levels can be improved. 
The key elements of Special Emphasis have been incorporated into the 
ongoing Title I program. As a result of the project, teachers 
appeared to be inclined to seek advice and assistance from reading 
specialists in teaching reading within their classrooms. This situation 
stands in contrast to the situation found at the cotiq)ari3on school 
where the reading specialist appears to be viewed as an adjunct to the 
school reading program and is not regularly sought out by teachers for 
fiLSSistance. The district's reading supervisor no longer sees the need 
for "pull out" programs in the primary grades, since the use of reading 
specialists within the classroom has been so successful. Sixty-seven 
percent of the teache' s in the experimental school predicted residual 
effects in teacher practices, chiefly in the use of materials, skills 
assessment, and in the adoption of learning stations and instructional 
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grouping within the classroom. Parent volunteers were incorporated 
into the school environment and became aides in the instructional 
program. School and district personnel expect parent involvement to 
be extended in future years. 



TABLE 5.37 
TEACHERS' ASSESSMENTS OF ATTITUDES 



SlC«: TBXAS 

School: S7ECXAI. EMPHASIS 



Ass«sra«ac of: 


Poslclvtt 
Qunga 

X 


No 
Chang* 

X 


Ifagaclvtt 
Changii 
X 


Cannot 
Tall 
X 


No 

Raaponaa 

X 


toward rtadlag 


1978 


52 


?? 


. 




10 


1979 


60 


5 


5 


30 




tftachars' acclcud«t covard 
TMdlng lascrucnloa 


1978 


48 


33 


10 




10 


1979 


70 1 5 


5 


15 


5 


Principals' acclcudas 
coward raadlag prograa 


1978 


14 


52 


10 


- 


24 


1979 


20 


45 


10 


25 





School: COMPA&XSON 



! -..-..,„..^ Efface 
iTaachars* ^""-^^^.^..^^^^^^^^^ 
Aaci^aananc of; 


Poaidva 
Changa 
X 


Uo 
Changa 
X 


NagatiTa 
Changa 

m 


Cancot 
TaU 
X 


No 

Raaponaa 

X 


Studaut*' acclcudaa 
coward raading 


1978 


72 


28 


- 


- 




1979 


74 


17 


- 


4 


4 


laachara' actlcudaa toward 
raading inacruccion 


1978 


68 


28 








1979 


48 


39 






4 


iPrineipala' accicudaa 
jcoward raading program 


1978 


52 


40 


- 1 - 1 8 


1979 


30 


35 


- 1 30 


4 



Hon-raaponsa or rounding aatiaatas are rcaponaible for row totals belov or above 
lOOX. 
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TABLE 5.38 

TEACHERS' ASSESSMENTS OF STUDENT READING BEHAVIORS* 



SlMS TEXAS 



School: S?ECZi>L ESIPHASIS 



TMch»r«' ^^"""^.^ Effect 
Stud«nc S«a<llng Bchavlora _ 


Z 


^0 

Changs 
Z 


Negaciv* 

Changt 
Z 


Cannoc 


No 

Retfpona* 
t 


Tin tp«]ic r««diaa 


1978 


43 


48 






10 


1979 


60 


30 




10 




outs^tt of elua 


1978 


29 


57 








1975 


40 


25 


10 


25 




Ubraxy u^/or 


1978 


38 


52 






10 


1979 


55 


30 


5 


10 





School: CQMPAaiS02Y 



Toachora ' Effect 
Aaaaanaac of 

SCudanC Saadlng Bohaviora ""^ ^ 


?oslclva 
Changs 
Z 


Ho 
Changs 

Z 


1 Kasaclva 
' Changs 
z 


Cftnnoc 1 

Tail 1 Rasponsa 

2 T 


Tlaa apanc raadlng 
in daaa 


1978 


96 


4 


1 - I - 


W79 


70 


26 


! - 1 4 


Tlaa raadlng 
oucalda of class 


1978 


72 


24 




- 1 4 


1979 


70 


13 




13 1 4 


Library and/or 
claasrooB book uaaga 


1978 










1979 


74 


17 


I 4 i 4 



* 

Ron-raaponsa or rounding ostiaatas ars rasponsibla for air tctalii balov or obova 
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TABLE 5.39 

TEACHER CONCERNS RESULTING FROM SPECIAL EMPHASIS INVOLVEMENT* 
Site: TEXAS 
School: SPECIAL F (PHASIS 





Year 


Major 
Problem 


Minor 
Problem 

z 


Not A 
Problem 


Teacher dissatisfaction with 
project objectives 


1978 


19 


33 


33 


1979 




25 


70 


Con£liCh between project objectives ar' 
other district objectives 


1978 


5 


29 


52 


1979 


5 


40 


50 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 


10 


24 


57 


1979 


5 


30 


§0. 


Conflict between teachers and reading 
specialists 


1978 


14 


?8 


33 


1979 


5 


15 


75 



School: COMPARISON 





Year 


Major 
Problem 
% 


Minor 
Problem 
% 


Not A 
Problem 
Z 


Teacher resentment of administering 
tests to students not benefiting 
from the project 


1978 


28 


56 


16 


1979 


17 


39 


35 


Teacher reseatmeat of extra work without 
receivln^^ new materials or other stipport 


1978 


44 


48 


8 


1979 


39 


26 


30 


Parental complaints about 
tes ting 


1978 


12 


36 


52 


1979 


4 


17 


70 


Teacher feelings that reading is 
emphasized at expense ot other programs 


1978 


4 


28 


64 


1979 


4 


22 


65 



Non-rasponse or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.40 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADE 3* 
Site: TEXAS 
Year: 1978 





School 


Yes 
Z 


Some- 
times 
% 


No 
Z 


Reading Is fun 


special 
Eorphasis 


39 


55 


6 


Comparison 


41 


51 


6 


I like to read during 
my free time 


Special 
Emphasis 


55 


36 


9 


Comparison 


63 


31 


5 


I like my reading class 


Special 
Emphasis 


62 


20 


4 


Comparison 


58 


27 


13 


I read only when 
1 have to 


Special 
Emphasis 


31 


30 


40 


Comparison 


41 


28 


29 


Year: 1979 








School 


Yes 


Some- 
times 


No 


Reading la fun 


Special 
Emphasis 


75 


18 


3 


Comparison 


57 


39 


4 


I like to read during 


Special 
Emphasis 


48 


42 


6 


my free time 


Comparison 


43 


47 


9 


I like my reading class 


Special 
Emphasis 


69 


16 


11 




Comparison 


79 


15 


6 


I read only when 
I have to 


Special 
Emphasis 


32 


25 


39 




Comparison 


43 


29 


28 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.41 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADES 4-6* 
Site: TEXAS 
Year: 1978 



Reading Attitudes 


School 


Yes 
Z 


Some- 
Times 
Z 


No 
Z 


Do ycu like to read? 


Special 
Emphasis 


47 


50 


2 


Comparison 


A4 


52 


4 


Do you read better this year 
than last year? 


Special 
Emphas Is 


76 


18 


5 


Comparison 


78 


11 


10 


Reading Habits 


School 


0 
% 


1-5 
% 


6+ 
Z 


How many hoars do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


17 


62 


19 


Comparison 


14 


57 


28 


How mar; books have you 


Special 
Emphasis 


3 


31 


65 


read during the past month? 


Comparison 


8 


29 


62 



Year: 1979 



Reading Attitudes 


School 


Yes 
Z 


Some- 
Times 
Z 


No 
Z 


Do you like to read? 


Special 
Emphasis 


49 


50 


1 


Comparison 


48 


49 


2 


Do you read better this year 
than last year? 


Special 
Emphasis 


91 




8 


Comparison 


88 




11 


Reading Habits 


School 


0 

Z 


1-5 
Z 


6+ 

Z 


How many hours do you spend 
reading outside of school 
per week? , 


Special 
Emphasis 


13 


70 


16 


Comparison 


15 


61 


23 


How many books have you 
read during the past month? 


Special 
Emphasis 


5 


25 


69 


Comparison 


4 


33 


63 



ii 

Non-response or rounding estimates are responsible for row totals below 
or above lOOZ. 



TABLE i.42 
SUMMARY OF PARENT SURVEY* 



Site: TEXAS 
Year: 1978 





School 


Yes 
Z 


No 
Z 


Cr.TlXlO t 

Say 
Z 


Does year child share books 

with voti or voiif familv? 


Special 
Emphasis 


79 


18 


2 


Comparison 


78 


18 


2 


Does the school set up 
parent/teacher conferences? 


Special 
Emphasis 


37 


50 


11 


Comparison 


58 


32 


7 


Have you worked as a 
volunteer in your child's 
school this year? 


Special 
Emphasis 


7 


80 


2 


Comparison 


7 


80 


3 



Year: 1979 





School 


Yes 
Z 


No 
Z 


Cannot 
Say 
Z 


Dc^a your child share books 
vith you or your family? 


Special 
Emphasis 


82 


13 


3 


Comparison 


87 


11 


1 


Does the school set up 
parent/ teacher conferences? 


Special 
Emphasis 


46 


32 


21 


Comparison 


69 


19 


11 



Non-*response or rounding esnimafes are responsible for row totals below 
or above 100%. 



WEST VIRGINU 



Summary 



The ANCOVA for the •'lAole grade" and "below mean" cohort g' oups 
in West Virginia showed scattered instances of significant differences — 
some favoring the Special Enq^hasis group, some favoring the comparison 
group. In the "below mean" analysis, the sixth grade Special Emphasis 
group had statistically significant differences in the adjusted posttest 
scaled scores in project years 1977-78 and 1978-79. The treatment 
and the comparison schools had comparable increases in students reading 
1 or more years belcw grade level over the 1977-79 period, with the 
comparison school registering a decrease of 1% during 1977-78. 

Approximately half of the Special Emphasis school classroom 
teachers said that they will continue to employ reading instruction 
methods used in Specia3. Emphasis. 

The following subsections describe in detail the project outcomes 
for West Virginia. 

Covariance Analysis of "Whole Grade" Cohort Groups 

The summary of the ANCOVA for each grade in West Virginia Special 
Emphasis and comparison schools is contained in Table 5.43, ANCOVA 
Impact Summaryc Complete data can be found in the tables contained in 
Appendixes E and F. For project year 1977-78, statistically significant 
differences in the adjusted posttest scaled scores were identified for 
grades 4 and 5. In both instances, the adjusted posttest scaled scores 
for the comparison group exceeded those for the Special Emphasis group. 
The average observed changes in grade equivalent for the comparison 
group were 1.9 at grade 4 and 1.4 for grade 5; for the Special Emphasis 
group, .9 and .05, respectively, for grades 4 and 5. For the fourth 
grade, serious ceiling effects were encountered in the pre- and posttest 
for the Specia]. Emphasis group and the posttest of the comparison 
group precluding interpretation of the observed change in grade equiva- 
lent. F>r the fifth grade, there were ceiling effects on the pretest — 
resulting in an overestimate- of the true change in grade equivalent. 
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TABLE 5.43 
ANCOVA IMPACT SUMMARY 

site: UESTVlRCiNU 





PROJECT yEAR 
1977-1978 






WIIOLE GRADE 
PROJECT YEAR 
1978.1979 






PROJECT YEARS 
1977.1070 




Grade 
Initial 
Year 


School 


Sig. 
of 
F 


Direction 

of 
lapact 


Change 
in 

Cr. Equiv. 




Cride 
Initial 
Year 


School 


sig. 

of 
P 


Direction 

of 
Impact 


Change 

in 

All 

Cr. Equiv. 




Grade 

initial 

Year 


ocnool 


Sig. 

01 


Direction 
of 


Cliange 
In 


2 


S.E. 

c. 


N.S. 




w.a 

+0.8 




2 


S.E. 
C. 


.01 


C, 


+0.6 
+0.8 




2 


S.E, 

r 




Gr. Eiiulv. 


3 


S.E. 

c. 


U.S. 




+1.6 
+1.8 




3 


S.E. 
C. 


N.S, 




+1.1 
+0.9 




3 


S.E. 
C. 


N.S. 




+1.9 
+1.6 


k 


S.E. 
C. 


<-0l 


C. 


+0.9 
+1.9 




k 


S.E. 

C. 


<.01 


S.E. 


+1.1 
+0.1 




4 


S.E. 
C. 


.04 


S.E, 


+2,7 
+1.8 


5 


S.E. 
C. 


.01 


c. . 


+0.5 
+1.4 




5 


S.E. 
C. 


N,S. 




+1.1 
+1.1 




5 


S.E. 
C. 


.04 


r, 


+2.2 


6 


S.E. 

C. 


N.S, 




+2.6 
+2.1 




6 


S.E. 


N.S. 




+0.9 

+0.3. 




6 


S.E. 
C. 


N.S. 




+1.3 
+I.B 
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Em CRADE HEAI! 



PROJECT YEAR 
1977-1978 






PROJECT YEAR 
1978-1979 




Grade 

Initial 

Year 


School 


Sig. 
of 
F 


Direction 

of 
Iipact 


Cliange 
in 

Gr. Equiv. 




Grade" 
Initial 
Year 


School 


Sig. 

of 

r 


Direction 

of 
iBpact 


Oiange 
in 

Cr. Equiv. 


2 


S.E. 
C. 


N.S. 




+1.1 
+0.8 




2 


S.E. 
C. 


N.S. 




40.7 
+0.8 


3 


S.E. 

.c. 


N.S. 




+1.5 
fl.3 




3 


S.E. 
C. 


<.01 


C. 


+0.7 
+1.2 


4 


S.E. 

c. 


.01 


c. 


+0.7 
+1.3 




4 


S.E. 
C. 


<.01 


S.E. 


+1.0 
+0.1 


5 


S.E. 

c. 


N.S. 




+0.6 
+0.4 




5 


S.E. 

c' 


N.S. 




+0.7 
+0.8 


6 


S.E. 

c. 


.02 


S.E, 


+2.5 
+1.5 




6 


S.E. 
C. 


<.01 


S.E, 


+1.2 
+0.1 



For project year 1978-79, the ANCOVA indicated statistically 
significant differences for grade. 2 favoring the comparison grout md 
for grade 4 favoring the Special Emphasis group. The average observed 
change in grade equivalent for grade 2 was .6 years for the Special 
Emphasis group and .8 years for the comparison group* The average observed 
change in grade equivalent for grade 4 was 1.1 for the Special Emphasis 
group and .1 years for the comparison group. Attention should be 
directed to the presence of ceiling effects for the grade 2 posttest 
scores resulting in an underestimate of the true change and for both 
pre- and post tests for the grade 4 Special Emphasis group and for the 
posttest for the comparison group indicating that the observed change 
may not be a good indicator of the true change. 

For the period 1977-79, the ANCOVA identified a significant differ- 
ence for grade 4 favoring the Special Emphasis group and for grade 5 
favoring the comparison group. This result parallels the ANCOVA results 
for the individual project years. The average observed change in grade 
equivalent over the 2-year period was 2.7 years for the grade 4 Special 
Emphasis group vs. 1.8 years for the comparison group, and 2.2 years for 
the grade 5 comparison group vs. 1.8 years for the Special Emphasis 
group. Ceiling effects were encountered for both grade 4 groups and 
for the grade 5 Special Emphasis group on the pre- and posttest. 

Covariance Analysis of "Below Mean" Cohort Groups 

Table 5.43 provides a summary of results from the below mean 
ANCOVA tables contained in Appendix F. For project year 1977-78, the 
ANCOVA identified statistically significant differences for grades 4 
and 6. The mean adjusted posttest scaled scores of the grade 4 compari- 
son group exceeded that of the Special Emphasis group. For grade 6, 
the mean adjusted posttest scaled score of the Special Emphasis group 
exceeded that of the comparison group. The average observed change 
in grade equivalent for the grade 4 comparison group was 1.3 years 
compared with .7 for the Special Emphasis group. The average observed 
change in grade equivalent for grade 6 was 2.5 for the Special Emphasis 
group vs. 1.5 for the comparison group — both educationally significant 
changes . 
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For project year 1978-79, the ANCOVA for the "below mean" cohort 
groups indentified statistically significant differences at grades 3, 
A, and 6. The adjusted posttest scaled scores of the Special Emphasis 
group exceeded those of the comparrson group at grades 4 and 6; the 
reverse was true at grade 3. Tb.e average bserved change in grade 
equivalent for grade 3 was 1.2 years for :hf omparis "be -an" 
group vs. .7 years for the Special Eniphasis "below mean" group, for 
grade 4 it was 1.0 years for the Special Emi^^iasis group vs. 0.1 years 
for the comparison group, and for grade 6 it was 1.2 years for r 
Special Emphasis group vs. 0.1 for the comparison group.. 

Trend A nalysis of Students Reading 1 or More Years Below Grade Level 

Table 5.44, Trend Analysis of S Undents Beading 1 or More Years 
Below Grade Level, combines data from 'tables D. 14-16 in Appendix D to 
provide a trend analysis of percentages of students in grade cohorts 
reading 1 or more years below grade level. 



TABLE 5.44 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 




In almost all cases, as students progress in grade level a larger 
percentage of students read 1 or more yeaxb be.low grade level. The 
exception to this general trend occurs for both schools between grade 5 
students in spring 1977 and grade 6 students in spring 1978. Table D.14 
in Appendix D shows that for students tested at Loch points there was 
an improvement in students who read 1 or more years below grade level in 
spring 1977 from 29 sLudents to 16 students in spring 1978 for the Special 
Emphasis school and from 29 students to 20 students for the comparison 
school. In addition, there were no grade 6 students in either school 
for 1977-78 who fell 1 or more years below grade level. 

Attention should be directed to the drop in the percentage of 
grade 2 students reading 1 or more years below grade level from spring 
1977 to spring 1979, from 19% to 5Z for the treatment school and from' 
32% to 21% for the comparison school. 

Table 5.45, Numbers of Students Reading 1 or More Years Below 
Grade Level, shows similar patterns for both schools between project 
years 1977-78 and 1978-79 in the change in percentage of students reading 
1 or more years below grade level. 

In 1977-78, the Special Emphasis school experienced only a 1% 
increase, from 27% to 28%, in the percentage of students reading 1 or 
mope years below grade level (based on only students tested both springs) . 
For the comparison school there was a decrease of 1%, from 32% to 31%, 
in the percentage of students reading below level. However, in project 
year 1978-79 both schools had an increase in the number of students 
reading 1 or more years below grade level — an 11%, increase, from 20% 
to 31%, at the treatment school and a 14% increase, from 24% to 38%, at 
the comparison school. 

Attitudinal and Behavioral Findings 

Teachers, students, and parents were surveyed in 1978 and 1979 
regarding perceived changes in reading attitudes and behaviors. Results 
of these surveys from the various respondent groups are presented below. 
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TABLE 5.45 

NUMBERS OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



sice: WEST VIRGDIU 





Treataenc School - Coaoarlson School 


I* tocal scuHtncs cescsd ac 
boc>h polncs* 


1977-78 1978-79 
223 263 


1 rroiecc lear , 
] 1977-78 1978-791 

i 

209 211 


Ba«irmlna oc ?ro1ecc Y«Ar 

2. Xc* scudancs CASCftd > I year 
balow grader 

3. X ot cocaX ttudaacs 

(Una 2/llna 1) 


60 53 
27Z 20Z 


\ 

1 

1 

67 50 ' 

\ 

32Z 24Z i 

I 
» 


End of ?ro1ecC Year 

So. scudancs caacad > I year 
balow grade I 

5. X ot cocal studencs 
(Una 4/Un« 1) 


62 32 
28Z 3U 


i 
i 

i 
( 
1 

65 81 1 

i 

31Z 38Z 1 







Spring 1977 and spring 1978 for 1977-78 
^Spring 1978 and spring 1979 for 1978-79 

^Spring 1977 for 1977-78 and spring 1978 for 19 78-79 

Spring 1978 for 1977-78 and spring 1979 for 1978-79 



Teachers 

• At the Special Eiiq>ha8i8 school, inxprovement in student 
reading attittides and behaviors, and teacher and principal 
attitudes were reported in 1978 and 1979. (Tables 5.46 
and 5.47) 

• At the comparison school, positive attitudinal and behavioral 
changes were reported for students in 1973. The percentage 
of positive change decreased in 1979. (Tables 5.46 and 5.47) 

• At the comparison school, teacher attitudes improved in 
1978 and 1979. (Table 5.46) 




• At the Special Emphasis school, no major problems were 
reported following the implementation of the project in 
1978 or 1979. (Table 5.48) 

• At the comparison school, the majority of teachers expressed 
resentment over the extra work due to their participation 
in the project in 1978 and 1979. (Table 5.48) 
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Students and Parents 

• At the Special Emphasis and comparison school, with the 
exception of students who reported they read during their 
free time, third graders reflected similar reading attitudes 
and behaviors in 1979. (Tables 5.49) 

• At both schools, fourth, fifth, and sixth grade students ' 
had similar reading attitudes and behaviors in 1979. 
(Table 5.50) 

Comparison school student data for 1978 and parent data for 1978 
flnrt wi»i?^ nofe paceived. Special Enq)hasis school parent data were 

not received in 1979. (Table 5.51) 

Refiiidiial Effects of Special Emphasis 

The West Virginia project evinced a modicum of carry over from 
Special Emphasis. According to district officials^ the lessons and 
techniques employed in Special Emphasis will be used by the district 
reading specialists as they move on to new (other) schools. (It is 
the district's intention to utilize reading specialists and the 
Wisconsin Design at different schools, shifting schools every 1 or 2 
years until all schools have received additional help in reading.) 
At the school level, the principal sees no continuation of Special 
Emphasis because of lack of resources. At the classrooia level., howevr»r, 
46% of the teachers claimed that they would continue to use the 
resource 'materials, skill building methods, and grouping features 
learned in the Special Emphasis inservice training ^program. Only 28% 
of the treatment classroom teachers had increased the number of methods 
of instruction by the end of the. project vs. 50% of the comparison 
school teachers. 
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TABLE 5.46 
TEACHERS' ASSESSMENTS OF ATTITUDES* 



Situ: WEST yiKSIBU, 
School: SFECIAI. EMTHASXS 



Aa«««ffMat of: 


Poslclvt 
Changtt 

X 


No 
X 


Negative 
Change 
X 


Cannot 
T«U 
X 


No 

Rasponae 

X 


jtovard rMdlng 


1978 


64 


36 








1979 


69 


15 


- 1 8 


8 


T«AchdftT»* aetltudfts covsrd 
rttadlns laseruetlon 


1978 


82 


18 








1979 


77 


8 


8 


8 1 . 


PrlaelpaXs' letltticUw 
tovard raadlng program 


1978 


82 


18 








1979 


85 


15 









School: CC^^&ISOM 



" .^^^ Effect . 

Teachers • 

Aaaeeemant of: _^ 


Poalclve 
Change 

: 


Vo 
Change 

X 


Negative 
Change 

: 


Cannot 
TeU 
X 


No 

Response 


Seudenta' aecicudaa 
toward reeding 


1978 


70 


30 


- 


- 




1!^79 


58 


25 


- 


17 




Teachers' ettitudes toverd 
reading Instruction 


1978 


70 


30 






1979 


67 


25 




8 




Principals' ateltndea 
coverd reeding progren 


1978 


30 


50 


- 




20 


1979 


17 


33 


- 


50 





Bon-response or rounding cjrtlmates are responiibXe for row cocala below or above 
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TABLE 5.47 

TEACHERS' ASSESSMENTS OF STUDENT READING BEHAVIORS* 



Sift WEST mciKIA 



School: SPECIAL E»FRASIS 



AaSMOMHC of 

Stttdttnt lUidltig B«luvlor« 


?o«ltlv« 
Cbans« 

X 


No 
Ch«ng« 
t 


Ctungt 
Z 


Caxmoc 
X 


No 
EUspoas« 
X 


TiM sp«nc rttadiag 
la cXass 


1978 


64 


36 








1979 


69 


23 






8 


TIm spue rMdlng 
oucaid* o£ c1mm» 


1978 


36 


36 




28 




1979 


54 


n 




15 




Library aad/or 
clasarooa book usag« 


1978 


64 


36 








1979 


54 


39 




8 





School: CQUPAaiSON 



T«ach«rs ' ---...^^ ZtUct 

AMmmnmtmsxt ot 

Scudanc Reading Bahavlora 


Posiciva 
Changa 
X 


He 
Cbanga 

X 


Nagsciva 
Chaaga 

: 


Cannoc 
TaU 

% 


No 

Rasponsa 

Z 


tlaa spaac raading 


1978 


90 








10 


In class 


1979 


67 


25 




8 




TlM spa&t raading 
ouesida of class 


.;?78 


50 


40 




10 


1979 


67 


17 




17 




Library and/or 
dassrooa book usaga 


1978 


40 


40 






20 


1979 


92 


8 









Mbir-raspoQsa or rounding aaclmacaa ara rasponsibla for rov corals ba^ow or abova 

loot. 
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TABLE 5.48 

TEACHER CONCERNS RESULTING FROM SPECIAL EMPHASIS INVOLVE^fENT * 
Site: WEST VIRGINIA 



School: SPECIAL EMPHASIS 





Year 


Maj or 
Problem 

Z 


Minor 
Problem 


Not A 
Problem 
7 

19 


Teacher dissatisfaction with 
project objectives 


1978 




18 


82 


1979 




23 


11 


Conflict between project objectives and 
other district objectives 


1978 




18 


82 


1979 




8 


92 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 




27 


73 


1979 




15 


85 


Conflict between teachers and reading 
specialists 


1978 




18 


82 


1979 




15 


85 



School: COMPARISON 





Year 


Major 
Problem 

% 


Minor 
Problem 
% 


Not A 
Prob lem 
% 


Teacher resentment of administering 
tests to students not benefiting 
from the project 


1978 


40 


50 




1979 


17 


25 


50 


Teacher resentment of extra work without 
receiving new materials or other support 


1978 


30 


40 


20 


1979 


42 


25 


33 


Parental complaints about 
testing 


1978 




30 


60 


1979 






92 


Teacher feelings that reading is 
emphasized at expense of other programs 


1978 




10 


80 


1979 




8 


83 



* 

Non-response or rounding estimates are responsible for row totals below 
or above 100%. 




TABLE 5.49 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADE 3* 
Site: WEST VIRGINIA 
Year: 1978 





ocnowx 


Yes 
Z 


Soma- 
tlmes 
Z 


DiO 

Z 


Reading Is fm 


Special 
Emphasis 


45 


47 


8 


Comparison 


- 


- 


- 


I like to read during 
my free time 


Sp eels'' 
Emphasis 


63 


33 


4 


Ccmparlson 








I .like my reading class 


Special 
Emphasis 


71 


25 


4 


Comparison 








I r^ad only when 
I have to 


Special 
Emphasis 


53 


22 


25 


Comparison 








Year: 1979 






School 


Yes 

% 


Some- 
times 

z 


No 


Reading Is fun 


Special 
Emphasis 


78 


17 


5 


Comparison 


87 


13 


0 


I like to read during 


Special" ■ ' 
Emphasis 


47 


36 


17 


my free time 


Comparison 


61 


34 


5 


I like ray reading class 


Special 
Emphasis 


81 


15 


3 




Comparison 


87 


13 


0 


I read only when 


Special 
Emphasis 


20 


22 


58 


I have to 


Comparison 


27 


32 


40 



* — ' 
Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.50 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADES 4-6* 
Site: WEST VIRGINIA 
Year: 1978 



'^i * Reading Attitudes 


School 


% 


Some- 

T^ TTKa Q 

% 


% 


Do you like to read? 


Special 
Emphasis 


49 


47 


4 


Comparison 








So you read better this year 
than last year? 


Special 
Emphas is 


78 


16 


5 


Comparison 








Reading Habits 


School 


0 
% 


1-5 

% 


6+ 

% 


How many hours do you spend 
reading outside of school 
per veek? 


Special 
Emphasis 


24 


i9 


2C 


Comparison 








How many books havo you 
read during the past month? 


Special 
Emphasis 


13 


19 


66 


Comparison 









Year: 1S7P 
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Reading Attitudes 


School 


Yes 
Z 


1 Some- 
Times 
Z 


No 
% 


Do you like to read? 


Special 
Ett2phasls 


43 


53 


4 


CoiFiparlson 


53 


44 


2 


Do you read better this year 
than last year? 


Special 
Emphasis 


94 




5 


Comparison 


91 




8 


Reading Habits 


School ■ 


0 
Z 


1-5 
% 


6+ 

Z 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


21 


67 


11 


Comparison 


16 


68 


14 


How many books have you 
read during the past month? 


Special 
Emphasis 


3 


38 


58 


Comparison 


5 


45 


48 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.51 
SUMMARY OF PARENT SURVEY* 

Slta: WEST VIRGINIA 
Tear: 1978 





School 


Yes 
Z 


No 
Z 


Cannot 
Say 
Z 


Does yovr child. share books 
with you or your family? 


special 
Emphasis 


85 


15 


2 


Comparison 








Does the school set up 
parent /teacher conferences? 


Special 
Emphasis 


44 ' 


31 


24 


Comparison 








Have you worked as a 
volunteer in your child's 
school this year? 


Special 
Emphasis 


4 


83 


3 


Comparison 









Year: 1979 





School 


Yes 
Z 


No 
Z 


Cannot 
Say 
Z 


Does your child share books 
with you or your family? 


Special 
Emphasis 








Comparison 








Does the school set up 
parent/teacher conferctnces? 


Special 
Emphasis 








Comparison 








Have you worked as a 
volunteer in your child's 
school this year? 


Special 
Emphasis 








Comparison 









Non-*response or rounding estimates are responsible for row totals below 
or above 100%. 
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CALIFORNIA 



Summary 



The ANCOVA for the California site indicated no consistent 
statistically significant differences. In viewing the ANCOVA results, 
it should be noted that the sample sizes are small. Both the treat- 
ment and comparison schools experienced approximately a 17-18% increase 
in the percentage of students reading 1 or more years below grade level 
during the 1978-79 project year. 

Potential for carry over from this project appears to be limited 
to teachers' continued use of the project materials. 

The following subsections describe in detail the project outcomes 
for California. 

Ccvariance Analysis of "Whole Grade" Cohort Groups 

The suumnary of the ANCOVA for each grade in the Special Emphasis 
and comparison schools in California is contained in Table 5.52, ANCOVA 
Impact Sumnary. For project year 1977-78, a statistically significant 
difference in the adjusted posttest scaled score grade 4 was identified 
for the adjxisted posttest scaled sco7 ^ of the Special Emphasis group 
exceeded that of the comparison group. The average observed change in 
grade equivalent was .8 years for the grade 4 Special Emphasis group 
and .3 years for the comparison group. Attention should be directed 
to the presence of ceiling effects in the pre- and posttest scores 
of the Special Emphasis group and in the posttest score of the 
comparison group indicated that the observed change in grade equivalent 
may not be a good estimator of the true change. 

For project year 1978-79, the ANCOVA indicated a statistically 
significant difference for grade 3 in which the adjusted posttest 
scaled score for the comparison group exceeded that of the Special 
Emphasis group. The average observed change in grade equivalent for 
the comparison group was 1.3 years vs. .7 years for the Special 
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TABLE 5.52 
ANCOVA IMPACT SUMMARY 



Site: mmik 



HHOLE GRADE 


rmJEci 


m 
m 




PROJECT YEAR 
1978-1979 




PROJECT 1 
1977- 


(EARS 
1979 


Gride 
Initial 


School 


Sl|. 

.of 

ff 

f 


Direction 
of 


Change 
in 

tit Kfliilv 


Grade 

lnk;«l 
Tear 


1 

School 


Slg. 
of 

V 

* 


Direction 
of 

--iSSHi — 


Change 
in 

Git EquIv. 


Grade 
Initial 


School 


Slg. 
of 
F 


Direction 
of 

10)1 II (,t 


QiBnge 
In 


2 


S.E. 

C. 


N.S. 


m 


+0.5 


2 


'3.R. 
C. 


N.S. 


IP 


+0.7 
+0.4 


2 


S.E. 
G. 


ilk 






3 


S.E. 

.c. 


N.S. 


m 


+0.3 


3 


S.E. 
C. 


<.01 


c. 


+0.7 
+1.3 


] 


S.E. 
C. 


m 








S.E. 
C. 


<.01 


u. 


+0.8 
+0.3 


k 


S.E. 
C. 


H.S. 




+0.4 
+0.6 


4 


S.E. 
G. 


m 






5 


S.E. 

C. 


N.S. 


m 1 


+0.7 
+0.4 


5 


S.E. 

C. 


N.S. 


** 


+0.9 
+0.6 


5 


S.E. 
G. 


N/A 






6 


S.E. 
C. 


H.S, 




+1.2 
+1.6 


6 


S.E. 
C. 


N.S. 




+2.2 
+1.2 


6 


B.I. 

C. 


N/A 
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BELOU GRADE HEAN 


PROJECT YEAR 
1977-1978 




PROJECT YEAR 
1978-1979 


Grade 
Initial 
Year 


School 


Slg. 
of 
F 


Direction 

of 
Inpact 


Changi 
in 

Gr. Equlv. 




Grade 

Initial 

Year 


School 


Slg. 
of 
F 


Direction 

of 
lapact 


Change 
in 

Gr. Equlv. 


2 


S.E. 
C. 


H.S. 


• 


+0.6 
+0.6 




2 


S.E. 

C. 


N.S. 




+0.7 
+0.4 


3 


S.E. 

c. 


H,S. 


• 


+0.4 
+0.3 




3 


S.E. 
C. 


<.G1 


C, 


+0.5 
+1.4 


4 


S.E. 
G. 


<.0l 


S.E. 


+0.9 
+0.2 




4 


S.E. 
C. 


M.S. 




+0.4 
+0.5 


5 


S.". 
C. 


N.S. 




+0.3 
+0.2 




5 


S.E. 
C, 


N.S. 




+0.8 
+0.6 


6 


S.E. 
C. 


N.S. 




+1.3 
+1.0 




6 


S'.E. 
C. 


N.S. 




+1.4 
+0.9 



Emphasis group. Again, ceiling effects were encountered in both pre- 
and posttest scores of the comparison group and the pretest score of 
the Special Emphasis group. 

Covariance Analysis of "Below Mean" Cohort Groups 

For project years 1977-78 and 1978-79, there were statistically 
significant differences in the "below mean" cohort groups which 
paralleled the "whole group" ANCOVA results. The average observed 
change in grade equivalents for each "below mean" group was approximately 
equal to that of the corresponding "whole grade" group. 

Trend Analysis of Students Reading 1 or More Years Below Grade Level 
Table 5.53, Trend Analysis of Students Reading 1 or More Years 
Below Grade Level, combines data contained in Tables D.17 and D.18 
in Appendix D. It shows that, for the most part, more students dropped 
below level as they progressed in school grades from 1978 to 1979. 
The only exception occurs in the treatment school between the fourth 
grade in Spring 1978 and the fifth grade in Spring 1979 where the 
percentage of students reading 1 or more years below grade level fell 
from 59% to 39%. Referring to Table D.17 in Appendix D, the reason 
for the drop in percentage is the change in student body rather than 
the improvement of students during the project year. 



TABLE 5.53 

TREND ANALYSIS OF STUDENTS READING 1 OR MORE YEaRS BELOW GRADE LEVEL 



Slt«: CALITORHIA 



TfAtaanc School 



Sprlag 
1977 



Spring 
1978 



Spring 
1979 



Spring 
1977 



Cocparlson School 

Spring Spring 
1978 1979 
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Table 5.54, Number of Students Reading 1 or More Years Below 
Grade Level, shows that in the treatment school, the percentage of 
students reading 1 or more years below grade level (based on only 
those students tested each spring) rose from 15% to 32%, a 17% increase. 
In the comparison school, the percentage of students reading 1 or 
more years below grade level rose from 28% to 46%, an 18% increase. 



TABLE 5.54 

NUMBER OF STUDENTS READING 1 OR MORE YEARS BELOW GRADE LEVEL 



Site: CALIFORNIA 



1 

i 


Treatment School • Comoarison School) 


Project V*»ar 1 Proiect Year 


1 

t 

1 1. local snudeacs cesced ac 
boch poincs* 




1977-78 1973-79 
N/A 116 


1977-73 1978-791 

1 

i 

N/A 116 i 




1 
1 


i 3e«innin3 of Prolect Ye^ar 

2* No. atudeacs ceacad > 1 year 
below grade" 

3. Z of total studeats 
(line 2/liae 1) 


N/A 17 


i 
1 
1 

N/A 33 • 


N/A 15X 


1 

N/A 282 ! 




1 


End of Proiect Yaar 


N/A 37 


1 
1 

i 

N/A 53 i 


4. >To. students tested > L year 
below grades 

5. ^ of total students 
(Una 4 /line 1) 


N/A 322 


N/A 462 1 







* 

Spring 1977 and spring 1978 for 1977-73 
^Spring 1978 and spring 1979 for 1978-79 

'spring 1977 for 1977-78 and spring 1978 for 1978-79 

^Spring 1978 for 1977-78 and spring 1979 for 1978-79 
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Attltudinal and Behavioral Finding s 

Teachers, students, and parents were surveyed in 1978 and 1979 
regarding reading attitudes and related behaviors. 



Particular findings of interest from the various respondent 
groups are highlighted below* 

Teachers 

• In 1978, all Special Emphasis school teachers reported 
improvement in student reading attitudes and behaviors; 
in 1979, the percentage of teachers reporting Improvement 
dropped. (Tables 5.55 and 5.56) 

• In 1978 and 1979, half the Special Emphasis school teachers 
reported that the attitudes of their colleagues toward 
reading instruction showed no change. (Table 5.55) 

• In 1978 and 1979, half the Special Emphasis school teachers 
reported Improvement in the principals' attitudes toward 
the reading program. (Table 5.55) 

• From 1978 to 1979, student attitudes and behaviors and 
teacher and principal attitudes were reported to have 
Improved at the comparison school. (Tables 5.55 and 5.56) 

• In 1978 and 1979, one third of the teachers at the Special 
Emphasis school felt that reading was receiving too much 
attention and detracting from other program areas. 
(Table 5.57) 

• In 1978 and 1979, the majority of teachers at the comparison 
school resented the SDRT testing and extra work Special 
Emphasis imposed on them. (Table 5.57) 

Students and Parents 

• ' In 1978, a higher percentage of Special Emphasis school 

third graders thought reading was fun than did the 
comparison group. (Table 5.58) 
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• In 1978, fewer Special Emphasis school third graders read 
only when they had to. (Table 5.58) 

• In 1978 and 1979, fourth through sixth graders had similar 
reading attitudes and behaviors except for the amount of 
time reading outside of school. (Table 5.59) 

• In 1978, data collected from Special Emphasis and comparisoa 
school parents reveals no observable differences. (Table 5.60) 

Tables 5.55-5.60 present the attitudinal and behavioral data 
from which these findings were extracted. No comparisons of third 
grade or parent data for 1979 can be made due to the lack of data from 
the Special Emphasis school. 

Residual Effects of Special Emphasis 

Residual effects in California were difficult to assess. Special 
Emphasis at the California site, it seems, was more characterized by 
enthusiasm and esprit d' corps than by reading techniques or instruc- 
tional philosophy. Half of the teachers did attest that they would 
continue to utilize materials from Special Emphasis. Perhaps partici- 
pants may attempt to enkindle the enthusiasm they experienced in 
Special Eophasis in future assignments. 
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TABLE 5.55 
TEACHERS' ASSESSMENTS OF ATTITUDES* 



Sle«: CALITOMIIA 
School: SPECIAL EMPHASIS 



r^M^MM^''^ ^Kffact 

Aasttrauie o£: 


Posltlva 
Changa 

t 


No 
Chaaga 
Z 


Nagadva 
Changa 
X 


Cannot 
TaU 


No 
Haaponsa 

t 


Stiid«nt«' aetleudM 
towmrd reading 


1978 


100 










1979 


67 


17 




17 




Taaehara' attleudM coward 
raadlag lastroeeioa 


1978 


50 


50 








1979 


33 


50 




17 




Prlaeipala* aeeitudaa 
toward raadlaig prograa 


1978 


50 


33 




17 




1979 


50 


33 






17 



School: CQMPAaiSON 



--.....^^ Effact 

Taachars* 

Aaaaaaaant of: 


Posltlva 
Chaaga 


No 
Changa 
Z 


Nagatlva 
Changa 

Z 


Cannot 
TaU 
Z 


No 
Raapo.nsa 


Stttdaata' attltudaa 
tC'vard raadlng 


1978 


60 


10 






30 


1979 


83 


17 








Taachars* attltudaa toward 
caadlag iaacructlon 


1978 1 30 


30 


20 1 - 


20 


1979 


50 


17 




33 




Prlaeipala* attltudaa 
toward raadlng prograa 


1978 


30 


20 


10 




40 


1979 


50 






33 


17 



* 

Hon-raaponaa or rounding aatimatas ara raaponaibla for row totals halow or abova 
lOOZ* 
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TABLE 5.56 

TEACHERS' ASSESSMENTS OF STUDENT READING BEHAVIORS 



Slta: CALIFORNIA 



School: SPECIAL EKmsiS 



T«ach«ra' ^'^***-'«-...^.^^ Effect 

AaMMaaac ©if 

Scudwic R«#4ing Behaviors 


Posltlva 
Changa 
Z 


No 
Changa 
Z 


Kagadva 
Changa 
Z 


Cannoc 
TeXX 
% 


No 

Rasponaa 
Z 


Tint sp«&t raadiag 
la clMMt 


X978 


XOO 










X979 


XOO 










Tinm fwit reading 


X978 


XOO 










X979 


50 


33 






X7 


Library uid/or 
elawaroom book usaga 


X978 


XOO 










X979 


67 


33 1 







SchooX: COMf\EISON 



Taachars' Effect 
Aaeeaaaanc of . ^^^^^^-^^^ 
Scudane Reading Bahavlora ^^'"""^-^ 


Poeitive 
Changa 

Z 


No 
Changa 

Z 


Negative 
Change 
Z 


Cannoc 
Tell 

Z 


No 

Response 

Z 


Tine apenc reading 
in claae 


X978 


60 








20 


X979 


XOO 


- 


- 




- 


Time spent reading 
outside of claas 


X978 


20 


40 


- 


- 


40 


X979 






- 


83 


17 


Library and/or 
claaavrooB book usage 


X978 


40 


40 




i- 


20 


X979 


83 


X7 1 . 







I 




TABLE 5.57 

TEACHER CONCERNS RESULTING FROM SPECIAL EMPHASIS INVOLVEMENT* 

CALIFORNIA 

SPECIAL EMPHASIS 







Major 
iTE^oD xem 

z 


Minor 
r^roDxem 

z 


Not A 
Problem 
% 


Teacher dissatisfaction with 
project objectives 


1978 


- 


17 


83 


1979 






83 


Conflict between project objectives and 
other district objectives 


1978 






100 


1979 






83 


Teacher feelings that reading is 
enxphasized at expense of other programs 


1978 




33 


67 


1979 




33 


50 


Conflict between teachers and reading 
specialists 


1978 






100 


1979 




17 


67 



School: COMPARISON 





Year 


Major 
Problem 
Z 


Minor 
Problem 
% 


Not A 
Problem 

% 


Teacher resentment of administering 
tests to students not benefiting 
from the proj ect 


1978 


50 


20 


10 


1979 




67 


33 


Teacher resentment of extra work without 
receiving new materials or other support 


1978 


60 


10 


10 


1979 


17 


50 


33 


Parental complaints about 
tes ting 


1978 


20 


10 


40 


1979 






100 


Teacher feeliags that reading is 
emphasized at expense of other programs 


1978 


20 


10 


50 


1979 






100 



* 

Non-response or rounding estimates are responsible for otals bel w 

or above 100%. 



Site: 
School: 
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site: 
Year: 



TABLE 5.58 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADE 3* 
C ALIFORNIA 
1978 





School 


Yes 
% 


Some* 
times 
Z 


No 
% 


Read Ins is fun 


Special 
Emphasis 


53 


43 


3 


Comi>arlson 


30 


53 


13 


I like to read during 
my free time 


Special 
Emphasis 


57 


43 


0 


Comparison 


57 


34 


6 


I like my reading class 


Special 
Emphasis 


57 


33 


10 


Comparlsoti 


53 


26 


13 


I read only when 
I have, to 


Special 
Emphasis 


30 


13 


57 


Comparison 


51 


23 


23 


Year: 1979 






School 


Yes 
Z 


Some- 
times 
% 


No 

Z 


Reading Is fun 


Special 
Emphasis 








Comparison 


71 


25 


4 


I like to read during 
my free time 


Special 
Emphasis 






- 


Comparison 


37 


54 


8 


I like icy reading class 


Special 
Emphasis 










Comparison 


79 


12 


8 


I read only when 


Special 
Emphasis 








I have to 


Comparison 


33 


46 


21 



Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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TABLE 5.59 

STUDENT ATTITUDES AND BEHAVIORS REGARDING READING - GRADES 4-6* 
Site: CALIFORNIA 
Year: 1978 



Reading Attitudes 


School 


Yes 

X 


Some- 
Tlmes 
% 


No 
% 


Do you like to read? 


Special 
Emphasis 


58 


40 


1 


Comparison 


50 


41 


1 


Do you read better this year 
than last vear^ 


wye L^XCl X 

Emphasis 


82 


7 


9 


Comparison 


74 


11 


9 


Reading Habits 


School 


0 

A 


1-5 
% 


6+ 
% 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


4 


67 


25 


CompariscTi 


25 


57 


12 


How many books have you 
read during the past month? 


Special 
Emphasis 


3 


24 


67 


Comparison 


2 


33 


59 



Yr^r: 1979 



1 

Reading Attitudes | Srhool 


Yes 
% 


Some- 
Tlmes 
% 


No 

% 


Do ypu like to read? 


special 
Emphasis 


55 


45 




Comparison 


58 


37 


2 


Do you read better this year 
than last year? 


Special 
Emphasis 


97 




3 


Comparison 


85 




10 


Reading Habits 


School 


0 
% 


1-5 

% 


6+ 

% 


How many hours do you spend 
reading outside of school 
per week? 


Special 
Emphasis 


5 


77 


18 


Comparison 


26 


54 


18 


How many books have you 
read during the past month? 


Special 
Emphasis 


1 


14 


85 


Comparison 


e 
J 


31 


60 




* 

Non-response or rounding estimates are responsible for row totals below 
or above 100%, 

^"^^ O ^ 



TABLE 5.60 
SUMMARY OF PARENT SURVEY* 

Site:- CALIFORNIA 
Year: 1978 





School 


Yes 

z 


No 

z 


Cannot 
Say 

z 


Does your child share hooks 
with you or your family? 


Special 
AmpnasiS 


ft? 




X 


Comparison 


71 


19 


2 


Does the school set up 
parent / teacher conferences ? 


Special 
Emphasis 


55 


35 


7 


Comparison 


48 


34 


10 


Have you worked as a 
volunteer in your child's 
school this year? 


Special 
Emphasis 


9 


84 


1 


Comparison 


9 


73 


2 



Year: 1979 





School 


Yes 
% 


No 

z 


Cannot 
Say 
% 


Does your child share books 
with you or your family? 


Special 
Emphasis 








Comparison 


89 


1 




Does the school set up 
parent / teacher conference s? 


Special 
Emphasis 






Comparison 


61 


25 





Non-response or rounding estimates are responsible for row totals below 
or above 100%. 
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CKDSS SITE SUMMARY 

The results of the various outcome analyses for the seven sites 
may be used to create a total picture of the effects of the Special 
Emphasis concept as implemented in a variety of settings nationwide. 
This subsection provides a summative review of the covariance analyses, 
the trend analysis of students reading 1 or more years below grade 
level, the attitudinal and behavioral findings, and the residual 
effects of Special Emphasis projects. A statistical analysis of the 
impact data aggregated across project sites was not undertaken due to 
site to site differences in Special En5)hasis treatment, in participants, 
and in criteria for participation in Special Emphasis. Despite these 
differences, a review of in5)act results for each site in light of 
results of other sites can provide insight into the impact of the 
Special En5)hasis concept as carried out among the sites. Likewise, 
the emergence of any consistent patterns of impact or trends can be 
detected. 

Based upon process data and observations of the study team, it 
was anticipated that three project sites provided the greatest potential 
for impact to emerge. These three sites (Louisiana, Tennessee, and 
Texas), inq)lemented programs that closely conformed to Special 
Emphasis regulations and guidelines. These sites are called Group I 
sites. Group II consists of the remaining four sites (Michigan, 
Ohio, West Virginia, and California) at which program implementaflo- 
was in question and impact resu r ispect. Tables in this smr 
section present data for Group , u_oup II sites to distingu^st. 

sites which implemented the Special Empr^asis Program from those which 
implemented marginal or questionable programs. Table 4.46 contains 
the data from which these groupings were detennined. 

Covariance Analysis of "Whole Grade" Cohort Groups 

Table 5.61 illustrates the incidence of significant differences 
for the "whole grade" cohort groups for each project site. Four of the 
seven sites, Louisiana, Mi chi^ > . ' West Virginia, had si 

cant differences between the Spp md comparison grou^. 
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Of these sites, Louisiana and Texas both had a pattern of significant 
differences for grades 2 and 5 favoring the Special Emphasis groups. 
Both Louisiana and Texas represented Group I sites; each had highly 
operationalized Special Emphasis programs. At neither of these sites 
was there any evidence that the Special Emphasis treatment ' r grade 
2 or grade 5 was different than that offered at other grade levels. 
There were no other observed patterns. 



TABLE 5.61 

ANCOVA WHOLE GRADE COHORT GROUPS SUMMARY 



GROUP I 



Grade 


LOUISIANA 




TENNESSEE 


TEXAS 


1977-78 


1978-79 


1977-79 


1977-78 


1978-79 


1977-79 


1977-78 


1978-79 


1977-79 


2 


SE 


SE 


N/A 








SE 


SE 


N/A 


3 






SE 














4 




















5 


SE 


SE 


H/A 










SE 


SE 


6 






C 














GROUP II 










MICHIGAN 


OHIO 


WEST VIRGINIA 


CALIFORNIA 




Grade 


1977-78 


1978-79 


1977-79 


1977-78 


1977-78 


1978-79 


1977-79 


1978-79 




2 






N/A 






C 


N/A 






3 




C 












N/A 














C 


SE 


SE 






5 




C 






C 




C 






6 




N/A 


N/A 















Key: SE « S, ,iiflcant difference. Special Enphasls group 
Si;:nificant difference* conparison group 
*^ Significant difference 
N/ • " :;'tis not available 



Covarlance Analysis of "Below Mean" Cohort Groups 

The ANCOVA performed for the "below mean" cohort groups revealed 
more incidents of statistically significant differences than the "whole 
group" ANCOVAs, but consistent patterns of significant differences 
are extremely limited. Statistically significant differences emerged 
from the 1978-79 project year analysis in Louisiana where 4 out of 5 
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ANCOVAs indicated significance in favor of the Special Emphasis school 
at grades 2, 4, 5, and 6* The Texas site "below mean" cohort group 
analysis showed statistically aignif'' .it differences favoring the 
Special Emphasis school at grade 2 for both project years 1977-78 and 
1978-79. Both Louisiana and Texas are Group I sites* In all other 
instances, the significant differences were scattered among schools, 
grade x^/els, and project years. As Table 5.62 indicates, the incidence 
of significant differences occurred mainly in Louisiana and West Virginia, 
with the only consistent patterns present in Louisiana. 



TABLE 5.62 
ANCOVA BELOW MEAN COHORT GROUPS SUMMARY 



GROUP I 



Grade 


LOUISIANA 


TENNESSEE 


TEXAS 


1977-78 


1978-79 


1977-78 


1978-79 


1977-78 


1978-79 


2 


SE 


SB 






SE 


SE 


3 


















SE 










5 




SE 










6 




SE 











Gaoup ti 



Grmd« 


MICHIGAN 


OHIO 


WEST VIRGINIA 


rAi.troRNtA 


1977-78 


1978-79 


1977-78 


1977-78 


1978-79 


1977-78 


1978-79 


2 
















3 


C 








C 




C 










C 


SE 


SS 




3 




C 












6 






SE 


r 









SE - Significant difference. Special Knphasis group 

C ■ Significant difference, compariaon group 

- - No aignificant difference 

N/A " Data not available 
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Trend Analysis of IStudent Reading 1 or More Years Below Grade Level 

The results of the analyses contained in the Tables of Appendix 
D, Frequency Analysis of Students More Than 1 Year Below Grade Level 
in Reading Comprehension, show that as student cohorts progress in 
grade levels, more students fall 1 or more years below level each 
succeeding year a Ohio, however, the comparison group lost less 
"ground" than the Special Emphasis group and in Louisiana ^he Special 
Emphasis group did not fall below level as much as did the comparison 
group . 

In most of the sites, the total percentage (refer to Table 5.63) 
of students reading 1 or more years below grade level appears to be 
either decreasing or holding steady from 1977 to 1978 and from 1978 
to 1979 for both the Special Emphasis and comparison schools. While 
new second grade cohorts perform better on the SDRT each year in 
Louisiana, Michigan, Tennessee, Texas, and West Virginia, this does 
not completely account for the apparent overall "improvetaent" in the 
total percentage of students reading below level. Students leaving 
the observed school sample and not tested at a subsequent test point 
contribute to the observed improvement. In fact, a site-by-site analysis 
of numbers of students shows only two instances — Tennessee and West 
Virginia comparison schools in 1977-78 — where the total school per- 
centage of students reading 1 or more years below level decreases. 



TABLE 5.63 



FREQUENCY ANALYSIS OF STUDENTS MQRE THAN 1 YEAR BELOW 
GRADE LEVEL IN READING COMPREHENSION 



Special Smphaala School 
1977 1978 1979 




1977 1973 19 ;9 



OROUP T 



Louisiana 
Tennessee 
Texas 



372 
452 
IBZ 



372 
372 
182 



31% 
202 
15% 



352 
342 
172 



322 
202 
202 



322 
202 
162 



GROUP II 



Michigan 
Ohio 

Wesc Virginia 
California 



382 
272 
362 
N/A 



372 
N/A 
242 
242 



31% 
N/A 
29% 
28% 



442 
322 
402 
N/A 



40% 
N/A 
302 
392 



29* 

N/A 

37: 

49% 
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Attitudlnal and Behavioral Findings 

The following attitudlnal and behavioral findings summarize the 
results of the surveys of teachers , students, and parents across all 
sites. 

• The majority of Special Emphasis and comparison school 
teachers' perceptions regarding changes In reading-related 
student attitudes and behaviors reflect Improved attitudes 
and behaviors in 1978. Tha extent of teacher perceived 
Improvement in 1979 droppecU 

• No consistent pattern emerges from teachers' perceptions 
of their colleagues' attitudes regarding reading. 

• Many teachers either declined to comment or professed a 
lack of knowledge regarding their school principal's 
attitudes toward reading. 

• Teacher's problems with Special Enphasis seened to peak 
in 1978 and subside in 1979. For teachers in the Special 
Emphasis schools, problems generally were with the over 
emphasis on reading to the detriment of other subjects. 
Teachers in the comparison schools resented the extra 
work which Special Emphasis imposed when they received 

no pro.'^ram benefits. 

• Attitudo.s regarding reading and reading-related behaviors 
expressed by students and parents were similar in both 
treatment and comparison schools. 



Residual Effects of Special Emphasis 

Educational intervention programs generally have as their primary 
objective, the improvement of student performance — oftentimes measured 
by test scores. Student improvement on test scores, however, is not 
the only measure of educationally significant outcomes. The effective- 
ness of an intervention program may also be measured by the effect of 
the program upon the attitudes of participants (children, teachers, 
parents), the degree oi parent Involvement, and/ or "institutionalized" 
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changes evidence in individual teachers, reading programs, schools, 
and school systems. Not only are these changes meaningful in themselves, 
but they also may create a climate in which long-term effects on student 
performance may occur. ^ Often in Federally funded experimental or 
demons tratiou programs, little or no evidence of the program or the 
changes it was intended to introduce remains after Federal funding ends. 
Occasionally, however, there are program components or entire programs 
that are taken over by the local agency or school and are continued 
after Federal funding ceases* The continuation of a program after 
termination of Federal funding may be regarded as one of the best 
indicators of program success* On the other hand, an initial commitment 
to continue a project beyond Federal funding may be a major determinant 
of program success (if, indeed, it is successful). Within Special 
Emphasis, GRC found indications of both phenomena: Special Emphasis 
con^onents continued after Federal funding because of their perceived 
value to the school/district; and, a decision from the outset to 
interalize the Special Emphasis approach into the district's reading 
program. 

To determine the extent to wh:*ch Special Emphasis had effected 
change, teachers were asked in the spring of 1979 what changes they 
had perceived in attitudes and what programmatic changes would rerjiain 
after the Special Emphasis project was over. Then, in fall 1979, 
after the project ended, each project director, reading specialists, 
a sample of teachers, and a LEA official were questioned regarding 
tangible, residual effects of Special Emphasis. While some said that 
they were "wait;ing to see the evaluation results," others were ready 
to identify specific changes which they attributed to Special Emphasis. 



See the Head Start Newsletter (fall 1977) report on "Parents, Children 
Continuity," Administration for Children, Youth, and Families, DREW, 
1977. Results of several independent studies (Irving Lazar, et al.) 
on the long * erm effects of Head Start Participation have shown signifi- 
cant achievement gains for former Head Start participants. 

Paul Berman, Mllbrey Wallin McLaughlin, et al.. Federal Programs 
Supporting Educational Chang e. Vol. Ill, Factors Affecting Implementa- 
tion and Continuation (Santa Monica, California: The RAND Corporation, 
Report R-1589/7 HEW, 1978). 
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On every level— school district, school, classroom, and the 
home — the kinds of institutionalized carry over from Special Emphasis 
varied widely. The degree of certainty regarding the carry over also 
ranged from conjecture to documentation of fact. The greatest degree 
of carry over appears to have taken place in Louisiana, Ohio, Tennessee, 
and Texus — the sites in which school district officials were most 
strongly involved in the project. The level at which the greatest 
impact took place was at the classroom level. Only Texas and Tennessee 
were able to affect patterns of parent involvement. 

The key factors, or co)i?binations of factors, which promote institu- 
tionalization varied with each site. Overall, the key determinants 
appeared to be: 



A district official (usually the original proposal writer) 
took responsibility for the design and regular supervision 
of the project and also for making improvement in the 
system after the project ended. Thus, a combination of 
leadership and continuity from the central office was 
present. 

The project had specific objectives and special strategies 
designed to meet the objectives. In other words, there 
was a uniqueness to the project and not Trv»rely "more of 
the same" or simply a new text. In this regard, placing 
the reading specialist in the regular classroom, de^jignating 
the specialist as a resource for the classroom teacher with 
time set aside for conferences, and skills assessment with 
specific provisions for skill building to achieve goals 
were among the more prominent approaches . 

Symbols of success were also important. Over the course 
of a 3-year project, teachers and administrators needed 
to see signs of progress and accomplishment such as positive 
test score results, more parent involvement, improved 
teacher morale and enthusiasm. 
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• Teachers had "ownership" in the project. Regardless of 
whether the design and initiation of the project came 
from the district office, the teachers and specialists 
needed to make a creative input to the project and hr.ve 
a sense that their concerns and problems were heard. 

Two of the four sites which had the highest degree of project 
institutionalizatibn, Louisiana and Texas, also had the only consistent 
patterns of statistically significant differences between Special 
Emphasis and comparison schools. 
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APPENDIX A 
SORT TEST HISTORY 



A-1 ^GO 

o 
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TABLE A.l 
SDRT TEST HISTORY 



Project Year 1977-78 



Site: LOUISIANA 



Grade: 


2 


3 


4 


5 


6 


TOTAL 




Sp.Ea. 


Coup. 


Sp.Ea. 


Conp. 


Sp.Ea. 


Conp. 




Cotnpt 


Sp.Ea. 


Comp, 


Sp.Em. 


Coop 


i. Total No. Students took 
SORT (spring, fall 1977! 
spring 1978) 


57 


175 


62 


131 


66 


. * 

207 


64 


147 


64 


124 


313 


784 


I, No. Deslgnited ai Having 
Leamlna Probleai 


4 


16 


6 


9 


11 


1 


9 


0 


4 


0 


34 


26 


). No. took Spring/Fall 1977 
SDRTs only 


17 


47 


11 


34 


11 


110 


13 


47 


12 


38 


64 


276 


U No. took Spring 1978 SORT 
but not Spring 1977 SDRT 


7 


27 


14 


19 






3 


IB 


10 


18 


41 


87 


ii. No. In Saiple Slt« for 
ANCOVA Analyses 
(l-(2+3+il)) 


29 


85 


31 


107 


37 


91 


39 


82 


38 


68 


174 


395 



Error In coding froa Spring to Fall '77. 

f>Sprlng '78 but not Fall '77 due to codlna Project Year 1978-79 
error Spring ' 78 * 



Grade: 



School: 



I. Total No. Students took 
SDRT (spring, fall 1978; 
spring 1979) 



i. No. Designated as Having 
Learning Probleas 



J. No. took Spring/Fall 1978 
SDRTa only 



(V No. took Spring/Fall 1979 
SDRT but not Spring 1978 
SDRT 

Sir No. In Sample Size for 
ANCOVA Analyses 
(l-(2+3+4)) 

I "ERIC"" 



Sp.Ei. 



58 



18 



27 



Coop* 



153 



34 



23 



90 



Sp.Ea. 



58 



34 



Compk 



133 



37 



27 



64 



Sp.Ea. 



70 



10 



19 



11 



30 



Conp. 



136 



25 



20 



21 



70 



Sp.Ea. 



64 



19 



33 



Conp. 



138 



10 



36 



22 



70 



Sp.Ea. 



66 



46 



Cofflp. 



139 



30 



34 



71 



TOTAL 



Sp.Ea. 



316 



31 



70 



45 



170 



Coap, 



699 



50 



157 



127 



365 



TABLE A. 2 
SDRT TEST HISTORY 



Project Year 1977-78 

Site; HICHIGAH 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.Ea. 


Conpt 


Sp.En. 


Coap. 


Sp.Effl. 


Conrpt 


Sp.En. 


Conp, 


Sp.En. 


Conp. 


Sp.En. 


Conp. 


1. Total No. Students took 
SDRT (springy fall 1977; 
spring 1978) 


164 


us 


146 


123 


131 


109 


119 


126 


133 


112 


693 


615 


Zt No« Designated as Raving 
Learning Probleas 


LL 


4 


a 
0 


11 


6 


4 


11 


5 


7 


5 


54 


29 


3. No. took Spring/Fall 1977 
SDRTs only 


27 


42 


36 


28 


32 


28 


18 


28 


29 


32 


142 


158 


No. took Spring 1978 SDRT 
only 


33 


38 


16 


20 


26 


21 


21 


27 


16 


15 


112 


121 


S. No. in Saaple Size for 
ANCOVA Analyses 
(l-(2+3+4)) 


82 


61 


86 


64 


67 


56 


69 


66 


61 


60 


385 


307 



Project Year 1978-79 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.Ea. 


Conp. 


Sp.En. 


Conp, 


Sp.En. 


CODpi 


Sp.En. 


CoBlpf 


Sp.En. 


Conp. 


SpiEm. 


Conp. 


I. Total No. Students took 
SDRT (aprlng, fall 1978; 
iprlng 1979) 


157 


135 


161 


128 


130 


119 


130 


103 


N/A 


N/A 


578 


485 


2. No. Designated ai Having 
Learning Problena 


8 


7 


4 


5 


4 


9 


2 


3 


N/A 


N/A 


18 


24 


). No. took Spring/Fall 1978 
SDRTs only 


43 


37 


33 


27 


20 


26 


23 


17 


N/A 


N/A 


119 


107 


ii. No. took Spring 1978 SDRT 
only 


24 


26 


29 


25 


24 


18 


26 


19 


N/A 


N/A 


103 


88 


S. No. In Saaple Site for 
ANCOVA Analyses 
(l-(2+3+4)) 


82 


65 


95 


71 


82 


66 


79 


64 
(65) 


N/A 


N/A 


338 


266 
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TABLE A. 3 
SDRT TEST HISTORY 



Project tear 1977-78 



Site: OHIO 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 






1/1/ . mBi 


Cottp . 


Sd.Tm 


Coiop« 


So. Rn. 










Conp. 


L. Total No. Studenti took 
SDRT (spring, fall 1977; 
spring 1978) 


70 


70 


67 


61 


61 


45 


58 


50 


61 


49 


317 


275 


L No. Designated as Having 
Learning Probleu 


6 


3 


3 


0 


5 


0 


1 


0 


1 


4 


16 


7 


). No. took Spring/Fall 1977 
SDRTs only 


20 


20 


23 


17 


9 


18 


13 


18 


15 


15 


80 


88 


\. Mo. took Spring 1978 SDRT 
only 


7 


9 


12 


11 


8 


9 


9 


3 


10 


6 


46 


38 


S. Mo. in Saaple Sise for 
ANCOVA Analyses 
(l-(2+3+4)) 


37 


38 
01) 


29 


33 


39 


18 


35 


29 


35 


24 


175 


142 


Project Tear 1978-79 


Grade: 


2 


3 




5 




TOTAL 1 


School: 


Sp.Ea. 


Coop. 


Sp.Em. 


Comp. 


Sp.Eo. 


COBp. 


Sp.Em. 


Comp. 


Sp.Ev. 


Comp. 


Sp.EK. 


Comp. 


L Total No. Students took 
SDRT (spring, fall 197B; 


83 


41 


62 


58 


57 


45 


62 


32 


54 


36 


318 


212 


Z. No. Deaignated as Having 
learning Problena 


0 


2 


7 


0 


1 


0 


8 


1 


6 


0 


1 




3. No. took Spring/Pall 1978 
SDRTs only 


M/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


No. took Spring 1978 SDRT 
only 


M 


•t 


II 


II 


11 


II 


it 


ir 


11 


11 


M 


n 


S. No. in Sanple Size for 
ANCOVA Analyses 
a-(2+3+4)) 


II 

.! 




(1 


11 


11 


M 


m 


II 


11 


H 


II 


II 
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TABLE A. 4 
SDRT TEST HISTORY 



Project Year 1977-78 

Sits TENNESSEE 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.Ea. 


Coop. 


Sp.Ea. 


CODp. 


Sp.Ea. 


Coop. 


Sp.En. 


Conp. 


Sp.Ea. 


Coop. 


Sp.Ea. 


Coop. 


L Total No. Students took 
SDRT (aprlngt fall 1977; 
spring 1978) 


62 


41 


67 


52 


52 


40 


67 


33 


72 


41 


320 


207 


Z. No. Designated as Having 
Learning Probleas 


9 


5 


7 


13 


12 


11 


6 


9 


8 


12 


42 


50 


3* No. took Spring/Fall 1977 
SDKTs only 


10 


9 


10 


11 


6 


6 


9 


7 


9 


5 


44 


38 


L No. took Spring 1978 SDRT 
only 


10 


4 


9 


5 


3 


7 


7 


3 


8 


4 


37 


23 


U No. in Satple Site for 
ANCOVA Analyses 
(l-(2+3+4)) 


33 


23 


41 


23 


31 


16 


45 


14 


47 


20 


197 


96 


Project Year 1978-79 


Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.En. 


CoBp. 


Sp.Ea. 


Coop. 


Sp.Ea. 


Coup. 


Sp.Ea. 


Conp. 


Sp.Eo. 


Coop. 


Sp.Ea. 


Conp. 


L. Total No. Students took 
SDRT (spring, fall 1978; 
•print 1979) 


57 


40 


67 


41 


71 


45 


50 


43 


63 


35 


308 


204 


I. No. Designated as Having 
learning Probleas 


4 


3 


11 


7 


11 


8 


12 


11 


3 


11 


41 


40 


1. No. took Spring/Fall 1978 
SDKTs only 


11 


17 


13 


9 


6 


8 


5 


3 


40 


2 


75 


39 


No. took Spring 1978 SDRT 
only 


6 


3 


7 


4 


12 


6 


5 


8 


3 


4 


33 


25 


S. No. In Sample Size for 
ANCOVA Analyses 
(l-(2+3+4)) 


37 


17 


36 


21 


42 


23 


26 


21 


17 


18 


159 


100 
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TABLE A. 5 
SDRT TEST HISTORY 



Project Year 1977-73 



Site: TEXAS 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.En. 


COtBpt 


Sp.Ea. 


Coup. 


Sp.Ea. 


Conp. 


Sp.Ea. 


CODp. 


Sp.Ea. 


Conp. 


Sp.Ea. 


Conp 


1« Total No. Students took 
SDRT (ipring, fall 1977; 
aprlsig 197n) 


161 


167 


135 


166 


120 


153 


* 

203 


272 


N/A 


N/A 


619 


758 


{. No. Designated as Having 
Learning Frobleoa 


4 


2 


7 


6 


9 


10 


7 


16 


N/A 


N/A 


27 


34 


}. No. r.ook Spring/Fall 1977 
SDRVs onlj 


43 


50 


38 


38 


26 


34 


115 


140 


>•'' 

afix 


N/A 


222 


262 


i. No. took Spring 1978 SDRT 
only 


27 


43 


25 


30 


24 


30 


16 


25 


N/A 


N/A 


92 


128 


S. No. in Saaple Slse for 
ANCOVA Analyses 
(l-(2+3+4)) 


87 


72 


65 


92 


61 


79 


65 


91 


M/A 


N/A 


278 


334 



Sixth grade atudents tested Fall 1977 
ttlscoded aa fifth graders. 



Project Year 1978-79 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.Ea. 


Coop. 


Sp.Ea. 


Coop. 


Sp.Ea. 


Coi^. 


Sp.Ea. 


Conp. 


Sp.Ea. 


Coap. 


Sp.Ea. 


Coap 


1. Total No. Studenta took 
SDRT (spring, fall 1978; 
spring 1979) 


131 


185 


154 


162 


139 


164 


135 


164 


N/A 


N/A 


559 


675 


Z. No. Designated aa Having 
Learning Probleas 


12 


2 


17 


7 


20 


3 


18 


12 


N/A 


K/A 


67 


24 


3. No. took Spring/Fall 1978 
SDRTs only 


24 


41 


28 


41 


41 


49 


30 


48 


N/A 


N/A 


123 


179 


No. took Spring 1978 SDRT 
only 


95+ 


136+ 


28 


37 


23 


24 


30 


26 


N/A 


N/A 


176 


223 


5. No. In Saaple Slse for 
ANCOVA Analyses 
(l-(2+3+4)) 


0 


6 


81 


77 


55 


88 


57 


78 


N/A 


N/A 


193 


249 



t o 

*ERIC Spring 1978 were 

^I tQBHtan coiplete SDRT. 



26 



TABLE A. 6 
SDRT TEST HISTORY 



Project Year 1977-7B 



Site; WEST VIRGINIA 



Grade: 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.Ea. 


Comp. 


Sp.Ea. 


Coop. 


Sp.Ea. 


Conp. 


Sp.Ea. 


Coup. 


Sp.Ea. 


CoiBp* 


Sp.En. 


Coap. 


L. Totcl No* SfciuliintA ti\hk 

SDRT (spring, fall 1977; 
spring 1978) 


70 


74 


68 


6S 


71 


65 


69 


72 


71 


74 


349 


350 


t. No. D«aign«tcd m Having 
Learning ProblcN 


5 


0 


7 


6 


8 


7 


0 


0 


0 


0 


20 


13 


h No. took Spring/Fall 1977 
SDRTs only 


10 


7 


11 


12 


17 


15 


8 


18 


14 


13 


60 


65 


\. No. took Spring 1978 SDRT 
only 


10 


IS 


6 


12 


8 


6 


9 


15 


12 


15 


45 


63 


S. No. in Saaplt Site for 
ANCOVA Analyaes 
(l-(2+3+4)) 


45 


52 


44 


35 


38 


37 


52 


39 


45 


46 


224 


209 



Project Year 1978-79 



Grade! 


2 


3 


4 


5 


6 


TOTAL 


School: 


Sp.Ea. 


Coap. 


Sp.Ea. 


Coap. 


Sp.Ea. 


Coap. 


Sp.Ea. 


Cottpf 


Sp.Ea. 


Coap. 


Sp.En. 


Comp. 


1< Total No. Students took 
SDRT (spring, fall 1978; 
spring 1979) 


83 


79 


66 


6? 


69 


63 


73 


66 


77 


68 


368 


345 


I. Ho. Designated as Having 
Learning Probleas 


0 


0 


3 


0 


4 


0 


7 


0 


0 


0 


14 


0 


i; No. took Spring/Fall 1978 
SDRTs only 


4 


13 


4 


21 


10 


15 


8 


14 


9 


24 


j5 


87 


ii No. took Spring 1978 SDRT 
only 


11 


8 


7 


8 


13 


8 


11 


14 


13 


9 


55 


47 


i. No. in Saaple Site for 
ANCOVA Analyses 
(l-(2+3+4)) 


68 


58 


52 


40 


42 


40 


47 


38 


55 


35 


264 


211 



g ERjc 266 



TABLE A. 7 
SDRT TEST HISTORY 



Project Year 1977 -78 



Site: CALIFORNIA 



Grad«: 
School: 


Sp.En. 


I 

Coop. 


3 

Sp.Ea. 


t 

CODp. 


i 

Sp.Ea. 


Conp, 


i 

Sp.En. 


Coap. 


( 

Sp.En. 


COBp. 


TOTJ 
Sp.Em. 

• 


COBD 
r 


Total No. Studenti took 
SDRT (fall 1977J 
spring 1978) 


40 


59 


29 


59 


34 


46 


36 


58 


33 


57 


172 


279 


i* No. Designated as Having 
Learning Probleas 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


y. No. took Fall 1977 
SDRTs only 


1 


11 


0 


13 


5 


14 


4 


6 


3 


6 


13 


50 


i« No. took Spring 1978 SDRT 
only 


3 


12 


2 


7 


0 


8 


5 


6 


1 


9 


U 


42 


\\ No. in Saaple Site for 
AttCOVA Analyses 
(l-(2+3H)) 


36 


36 


27 


39 


29 


24 


27 


46 


29 


42 


148 


187 



Project Year 1978*79 



Grade: 
School: 


Sp.Ei. 


I 

COBp. 


* 

Sp.Ea. 


( 

Coup. 


i 

Sp.Ea. 


Coap. 


i 

Sp.En. 


Conpt 


{ 

Sp.Ea. 


S 

Conp* 


TOTi 
Sp.Ea. 


\l 
Coap. 


L* Total No. Students took 
SDRT (spring, fsll 1978; 
spring 1979) 


65 


60 


50 


88 


54 


74 


46 


67 


49 


70 


264 


359 


U No. Designated as Having 
Learning Probleas 


0 


0 


1 


0 


0 


0 


0 


0 


0 


0 


1 


0 


1. No. took Spring/Fall 1976 
SDRTs only 


28 


24 


10 


24 


16 


26 


15 


23 


16 


27 


85 


124 


Ho. took Spring 1978 SDRT 
only 


12 


18 


9 


37 


16 


18 


9 


27 


14 


19 


60 


119 


• No. in Saaple Size for 
ANCOVA Analyses 
(l-(2+3M)) 


25 


18 


30 


27 


22 


30 


22 


17 


19 


24 


118 


116 1 
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APPENDIX B 

SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 
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TABLE B.l 

SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



SICK LOmSIAlU Project Y«*r: 1977-1978 



SCHOOL 




(aUDE (SpdAS 1978) 
2 3 4 5 6 


Sp«cl«l EaphMls 


PnCMC Oaly 
PesttMt Only 

Prscut Only 
PosttMt Only 


0 + 00 + 
+ 0 0 - - 

0 - N/A 0 

0 - + 0 0 



Project Y^at: 1978-1979 



SCHOOL 




GBAK (Spring 1979) 
2 3 4 3 6 


Spadal Sap«hsl« 

Cooparison 


PrfttMt Only 
Posttut Only 

Prstut Only 
PoflttMt Only 


0 0 + + - 
N/A + 0 + 0 

0-000 
0-0-0 



KET: 

0: 01ffanac« batvMn wman Mcalmd scorn of prn- or poattnsc only group iM XmMu 
chaa 1/3 standard davlntion from as an of T^ra- «nd posttsflt group. 

+: Maaa acalad acora of pra- or poatcaat only group la coora Chan 1/3 standard 
davlatloa hlghar than oaan of pra- and poattaac group. 

Haan acalad acora of pra- or poaccast only group Is aora Chan 1/3 standard 
davlacion lovar Chan aaan of pra- and poattaac group. 




TABLE B.2 



SUMMASY OF DIFFERENCES 3EWEHN STTIDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



SlwmCHIGAM Projtcc Imux: 1977-1978 







OUDE (Sprlnii 1978) 
2 3 4 5 6 


Coa|)«rison 


PrsMC Only 
Poflctast Only 

PraCMt Only 
PoflCCMC Oaly 


1 O O 1 
O 1 o o 
o o o o 
O 1 o o 
O O 1 o 



Projiicc Ytar: 1978-1979 



SCHOOL 


! 


GSAQE (Spring 1979) 
2 3 4 5 6 


Coap«rl«on 


Pr«t««c Only 
PoflCCMC Only 

Pr^CMc Only 
PoflCCMC Only 


0 0 - 0 N/A 
- 0 0 0 N/A 

0 - 0 0 N/A 
0 0 - N/A 



KST: 

0: DiffftTuea batVMa atan acAlftd scon o£ prt- or poaccMC ooly group U Uflfl 
Chan 1/3 ^taadard davlaclon froa dma of pr*- «nd poacCMC group. 

+i Mun scaltd acora of pra- or poaccaac only group ia nora Chan 1/3 scandard 
davlacloa hlghar ehaa aaaa of pra* and poaccaac grsup. 

Haan acaXad acora of pra- or poaccaac only group ia aora t h « n 1/3 scandard 
davlatlon lowar than aaan of pra- and poaccaac group. 



B-3 
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TABLE B.3 



SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



Site: OHIO Projtct Xuxi X977-L978 



SCHOOL 




GRADE (Spring 1978) 
2 3 4 3 6 


SptciaX EoptUMltf 
Cooparlaoa 


Prsttat Only 
PosttMt Only 

PrtCMt Only 
PotctMc Only 


0 + + 0 - 
0 + 0 + - 

- 0 0 - 0 

- 0 0 + - 


Project Y«*r: 1978-1979 


SCHOOL 




GRADE (Spring 1979) 
2 3 4 2 6 


SpftdJiL Eapahals 
Conparlson 


Precast Only 
PoattMt Only 

PrftCMt Only 
Poeccut Only 


- - N/A - - 



KET: 

O; Dl£f«r«ae« btcvMn aun gcalftd scors of prt- or potcctst only group is 1ms 
Chan 1/3 scandnrd davlAtlon froa maan of pn~ and poactaac group. 

+: (tean acalad aeora of pra- or poacctac only group la laora than 1/3 standard 
davlaclon hlghar Chan naan of pra* and poaccaac group # 

Maan scalad acora of pra- or poaccaac otay group la oora chan 1/3 standard 
davlaclon lowar than maan of pra- and posttaat group. 



B-4 
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TABLE B.4 



SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



Site TENNESSEE 



SCBOOL 



Project Y«Ar: 1977-1978 



Ptscmc Only 
PoflCCMC Only 

PraCMC Only 
PoflCMc Only 



GRADE (Spring 1978) 
3 4 5 6 



0 
+ 

0 
+ 



+ 

0 



0 
+ 



+ 



Project Tear: 1978-1979 





SCHOOL 




C8ADE (Spring 1979) 
2 3 4 5 6 


SpsdAl Effipahclfl 


Pr«c«flc Only 
Poaccuc Only 

Prnctac Only 
Poflcctac Only 


-00+0 

0 + 0 -r + 

0 + 0 - 0 
+ + . 0 




Coapanson 



XST: 

O: 



B-5 
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TABLE B.5 



SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



Sif ;roXAS Projacc Y««r: X977-X978 



SCBDOL 




GRADE (Sprlxig 1978) 
2 3 4 5 6 


SpseUl Eaphaslfl 
Coaparlson 


PrftCMt Oaly 
PoflCtMt Only 

Prsctat Ooly 
PoflCt^uc Only 


0 0-0- 
0 0 - - - 

0 0 0 0 - 
0 0 0 0 - 



Projacc Y««r: X973-X979 



SCHOOL 




GRADE (Sprlag X979) 
2 3 4 5 6 


Spsclftl Sapahala 
Conparlson 


PrttCMC OttXy 
Poflccuc OtUy 

PrttCMC OnXy 
PoflCCMC OaXy 


M/A 0 0 0 - 
M/A - 0 - - 

M/A 0 0 0 - 
+ 0 - 0 - 



KEY: 

O: 01ffar«nca bacvMn nun, tuXad acora of prtt- or poa cease only group Is Xms 
dun 1/3 flca&dard daviacion from omxi of pr«* and poactftsc group. 

+: M««a scalad scora of pra- or poaccaac onXy group la oore chaa X/3 standard 
daviatl<m hlghar than, naan of pra-* and poaccaac group. 

Maan acalad ac^ra of pra* or poaccaac only group la tnore Chan X/3 scand/.rd 
dr.vlacion lover than oiaan of pra- and poaccaac group. 
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TABLE B.6 



SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



S if; WEST VIRGINIA 



Project T«Ar: X977-X978 



scaooL 




<«RAOS (Spring 1978) 
2 3 4 5 6 




PtttCMC Oaly 
PofltCMt Only 

Prfttftsc Only 
PoflCCMC Oaly 


I O O 1 

II 1 o 
II 1 o 

O 1 O 1 



Project Tmt: 1978-1979 



SCBOOL 




GBAQE (Spring 1979) 
2 3 4 5 6 


SpaclAX Sapfihsifl 
Coi9*rl«on 


PrstMC Only 
PosctMC Only 

PrsCMC Only 
Postntac Only 


0 - - 0 - 

- - - 0 

- ' 0 - 0 

0 + 00 0 



KET: 



^^•^^^'•.''•rT.!!?" P"- " only group U U.. 

thM 1/3 auadud dwl»cioa fro* mu of pw- .ad poacctac gro^ 

^!^'m!^^k* 8^P t» chw 1/3 .cndurd 

d«vl«cifla hlgtwr tlua OMn of pw- and poaccaac group. 

-t ttean acAlad scor* of yra- or poaccaac only group la oora chan 1/3 standard 
davlAcloa lowar than oaaa of pra- an>5 poaccaac group. 
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TABLE B.7 



SUMMARY OF DIFFERENCES BETWEEN STUDENTS WITH BOTH 
PRE- AND POSTTEST SCORES AND STUDENTS WITH 
PRETEST OR POSTTEST ONLY 



Sita: CALI70BNIA 


Pro j tec Tftar: 


1977-1978 


SCHOOL 




2 


GKADE (Spriag 1978) 
3 4 5 6 


Spftdal Efflptusla 


PrtttMt OaXy 
PosttMt Only 






Coiflparlfloa 


PraCMt OoXy 
Posttut Only 







Project 7Mr: 1978-1979 



SCHOOL 




GBABE (Spring 1979) 
2 3 4 3 6 


SpttclAl Empahals 
ConpArlson 


PrtttsBt Only 
Poflttftst Only 

PntMt Only 
Posttftst Only 


O 1 O 1 

O 1 o o 
O 1 + o 



KEY: 

0: Difference becvcen seen scaled score of pre- or poattest only group Is leas 
than 1/3 standard deviation from oaan of pre- and poattest group. 

+: Mean scaled score of pre- or posttesc only group Is more than 1/3 standard 
deviation higher than mean of pre- and poattest group. 

-: Mean scaled score of pre- or posttest only group Is oors Chan 1/3 standard 
deviation lower than mean of pre- and posttest group. 



APPENDIX C 

MEAN RAW SCORES ON THE SDRT 
REPORTED BY CLASS 



"TABLE C.l 

MEAN RAW SCORES ON THE SDRT REPORTED BY CLASS 



Site; mUlSIANA School: SPECIAL EMPHASIS 



GRADE 


SDRT TEST POINTS 


SPRING 1977 


PALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FALL 197? 


n nean ind 


n Hean Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


N Hean ino 


1 


22 29.7 
25 34.6 




20 47.4 
20 25.5 F 




22 31.9 
22 33.5 




J 


16 76.6 C 
14 67.6 C 
12 58.1 


17 39.8 
20 37.7 


17 71.7 C 
19 75.4 C 


20 51.0 
16 43.7 


18 73.6 C 
18 76.9 C 


11 48.6 
9 52.8 




19 47.9 C 
16 35.8 


24 28.0 
23 26.9 


24 40.8 
21 37.6 


13 33.7 
21 21.8 


21 40.7 

22 40.2 


6 39.7. 
5 26.0 


4 


18 32.0 

17 46.0 C 

18 54.7 C 


28 42.1 C 
17 24.9 


25 47.8 C 
18 37.4 


18 36.0 
26 47.3 C 


18 48.7 C 
23 50.6 C 


10 46.2 C 
12 37.7 


5 


19 21.9 
16 38.2 


26 25.4 
21 23.4 


21 36.4 
18 33.1 


22 16.9 F 
24 28.7 


20 22.9 
20 37.4 


7 19.8 
3 20.3 
2 24.0 
11 28.4 


6 


26 42.0 C 

27 31.4 


26 23.1 
23 30.7 


24 31.5 
23 35.4 


27 38.6 
24 27.4 


31 45.1 C 
24 30.9 


7 30.3 

8 37.1 
3 21.0 


7 








11 27.7 
28 42.1 C 




25 40.1 
12 38.2 



Teat Uvel Maximum Score Floor (F ) Effect Below Celling (C) Effect Above 

Red 90 ~ 27 63 

Green 60 18 42 

Brown 60 18 42 
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site: LOUISIANA 



TABLE C.2 

MEAN RAW SCORES ON THE SDRT REPORTED BY CLASS 

School: COHPARISOM 



GRADE 


SDRT TEST POINTS 


SPRING 1977 


FALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FALL 1979 


N Mean lad 


N "Mean Ind 


N Mean Ind 


N Mean InA 


N Mpnn Tnd 


N Hp An Tn<'t 


1 


22 41.4 
24 41.6 
22 42.3 

24 47.4 
17 55.5 

25 45.9 




19 42.8 
29 56. U 
22 54.6 
24 45.9 
22 34.0 




26 47.0 
24 37.0 
,27 36.7 
28 52.9 




2 


22 73.1 C 
24 72.6 C 
22 69.7 C 
21' 72.8 C 
22 76.1 C 


16 47.6 

24 71.6 C 

24 43.7 

25 37.5 

26 56.6 


19 79.6 C 
24 85.9 C 
21 68.8 C 
24 64.6 C 
21 79.8 C 


25 73.2 C 

22 58.7 

23 48.1 

24 68.5 C 
23 52.3 


24 87.4 C 
23 75.7 C 

22 77.9 C 
21 65.8 C 

23 82.6 C 


16 58.4 
3 31.7 

17 42.2 

18 45.8 

20 67.7 C 


: 

3 


30 38.7 
24 40.8 
32 42.3 C 


28 28.5 

29 38.2 
32 33.2 


19 45.2 C 
23 39.5 

20 47. T C 
26 42. u C 


29 22.9 

33 44.1 C 

34 33.0 


n is A r 

■i J *fJmH \J 

16 43.5 C 
27 51.3 C 
22 47.0 C 


4 20.5 

7 29.8 
13 30.8 
10 34.3 

8 28.7 


4 


28 44.0 C 
25 44.9 C 
30 43.0 C 
25 48.8 C 
28 46.1 C 


29 36.3 
28 32,0 

30 37.5 
28 30.6 


20 42.6 C 

26 51.1 C 

27 45.9 C 

21 39.0 


16 21.7 
27 44.3 C 
29 54.6 C 
22 37.9 


24 49.9 C 

20 51.0 C 
26 44.3 C 

21 51.0 C 


14 45.7 C 
24 51.6 C 
19 44.9 C 
8 40.9 


5 


23 28.8 

24 32.1 
23 24.3 
22 31.5 


1 20.0 
25 22.3 
48 23.3 
25 19.4 
23 19.7 


18 18.5 
28 29.9 
18 43.5 C 
26 24.2 


23 17.1 F 
25 32.8 
2 31.0 
19 18.4 
28 16.7 F 


19 20.8 
27 34.9 
27 27.3 
6 21.3 


15 28.9 

3 16.3 F 
14 28.9 

14 24.5 

15 23.8 


6 


21 29.9 
30 30.4 

25 41.9 
28 30.9 

26 42.6 C 


27 18.4 
33 39.8 
29 24.2 
23 18.7 


8 24.4 
28 49.8 C 
26 34.3 
22 21.1 


12 19.6 
18 22.5 
30 40.0 
27 29.5 
25 25.9 


29 39.0 
20 30.8 

19 31.9 

20 37.0 
17 28.2 


21 26.5 
17 22.3 
21 36.2 
10 22.9 


7 




14 35.1 
33 35.1 
16 25.2 
53 34.3 




34 39.2 
53 27.0 




25 34.1 
20 25.7 
20 29.3 
19 34.4 
13 30.0 



Tegt Level 
Red 
Green 
Brovn 



Maximum Score 
90 
60 
60 



Floor (F) Ef fect Below 
if 
18 
18 



Ceiling (C) Effect Above 
63 
42 
42 



ERIC 
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TABLE C.3 

MEAN RAW SCORES ON THE SORT REPORTED BY CUSS 



Sltet MlCHICAM Scb.3ol: SPECIAL EMPHASIS 



GRADB 




SORT TEST POINTS 


SPRING 1977 
N Hean Ind 


FAIL 1977 
N Herin Ind 


SPRING 1978 
N ^ean Ind 


FALL 1978 


SPRING 1979 


FALL 1979 


1 


27 55.2 

27 47.8 
26 47.9 




24 46.4 
19 54.7 
19 46.9 

25 46.6 
21 43.8 


N Mean Ind 


N Mean Ind 

30 63.0 C 
24 50.5 
19 42.1 
21 43.3 


N ^ean Ind 


2 


26 66.8 C 
32 72.6 C 

29 66.5 C 


23 51.3 

24 55.9 
23 37.3 
27 52,0 


25 77.3 C 

29 77.0 C 

30 70.6 C 

31 75.9 C 


28 45.6 
25 59.6 

29 47.3 
23 55.6 


30 74.3 C 
23 80.8 C 

26 81.9 C 

27 80.0 C 


12 70.7 C 

12 66.3 C 
14 52.6 

13 34.7 


3 


30 42.7 C 
27 40.3 

IS IS 1 


29 30.3 
27 25.2 
25 31.0 
25 27.2 


25 44.0 C 
27 35.0 
25 43.4 C 
24 38.2 


27 33.4 
31 32.8 

28 33.7 
30 26.8 


30 44.4 C 
32 43.3 C 

31 41.7 C 
29 35.2 


26 29.2 
17 29.3 
24 37.2 
7 34.3 
6 28.0 
21 28.1 


A 
H 


18 46.9 C 
25 45.8 C 
24 49.5 C 


21 34.0 
27 39.5 
25 35.9 
25 39.5 


20 44.0 C 

24 44.5 C 

25 45.6 C 
24 49.1 C 


30 38.3 

31 30.6 

9 56.0 C 
27 38.7 


30 44.9 C 

29 39.2 

16 55.8 C 

30 47.5 


21 37.9 

22 39.7 

16 43.4 C 
18 46.3 C 


5 


25 28.0 
29 24.0 

26 24.8 
25 29.8 


21 23.2 

20 16.8 F 

21 15.3 P 
19 24.3 


23 31.9 
23 21.2 
22 16.7 F 
21 30.9 


28 18.3 
25 18.8 
15 24.2 
30 18.8 


32 18.7 
28 25.6 
15 37.3 
30 22.4 


24 21.6 
27 20.7 

25 16.6 F 
15 38.5 


6 


29 33.0 
26 28.8 
29 32.2 
26 36.4 


24 25.1 

25 25.1 
28 28.6 
19 19.4 


23 29.7 
26 31.5 

24 36.3 
24 30.6 






11 30.5 

18 19.8 

19 21.9 

20 20.6 



Teat Level Haxiaua Score Floor (F) Effect Below Cellln R (C) Ef fect Above 

Red 90 27 ^ 

Green 60 18 42 

Brown 60 ' ig 42 



ERIC 
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TABLE C.4 

MEAN RAW SCORES ON THE SORT REPORTED BY CLASS 



Sitst MICHIGAM 



School: COMPARISON 



GRADE 




SDRT TRST PniNTS 


SrKUKi 1977 


FALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FALL 1979 


N Mean Ind 


N Kean Ind 


N Hean Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


1 


21 41.3 
26 45.1 
24 49.7 
24 45.7 




28 50.4 

11 At Q 

30 42.6 




33 68.5 C 
33 60.3 




2 


27 58.5 

23 71.4 C 

28 72.1 C 


22 54.8 

21 44.7 
26 45.3 


26 74.1 C 

23 60.2 
26 74.9 C 


32 56.3 

33 54.4 


32 77.9 C 
<c3 70,3 C 

33 76.2 C 


23 52.9 
17 47.5 
26 41.3 


3 


22 42.4 C 
21 35.4 

21 39.2 

23 43.9 C 


25 25.9 

19 26.8 
24 27.9 


21 44.3 C 

LL JO* 3 

20 38.9 

22 38.7 


34 29.7 
31 35.1 


34 43.4 C 
30 48.3 C 


31 33.3 
22 26.5 
27 31.5 
14 28.1 


A 


21 44.4 C 

22 42.0 C 
24 C 
22 43.5 C 


23 46.4 C 
26 37.0 


28 48.8 C 
25 47.8 C 


30 45.3 C 

it Hi. J 

25 41.5 


27 47.4 C 

^1 Ail 1 n 

25 44.6 


14 41.1 
10 38.5 
22 46.3 C 
U 48.0 


5 


22 24.8 
24 25.3 
24 16.0 F 
20 19.7 


19 21.9 
25 22.8 
25 19.7 
24 16.7 F 


21 23.8 

24 26.8 

25 21.1 
23 21.5 


25 24.1 

25 24.0 

26 24.4 


25 27,3 

29 29 1 

30 29.6 


22 24.1 

22 18.3 
9 21.0 


6 


28 24.6 
32 33.8 

29 32.5 


21 25.7 
19 21.7 
21 27.6 
18 20.8 


17 33.6 
20 26.1 
19 33.2 

18 24.8 






18 26.8 
23 25.0 
22 27.7 



Te at Leve l 
Red 
Green 
Brown 



Maxinua Score 
90 
60 
60 



Floor (F) Effect Below 
27 
18 
18 



Cetllnit (C) Effect Above 
63 
42 
42 



ERIC 
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TABLE C.5 

MEAN RAW SCORES ON THE SDRT REPORTED BY CLASS 



Slut OHIO 



School: SPECIAL EHPIIASIS 



CHAPE 


- . SDRT TEST POINTS 


SPRING 1977 


FALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FALL 1979 


N Mean Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


I 


19 53.1 
32 6i.5 




24 54.6 
5 77.6 C 
29 46.9 








2 


26 72.4 ' C 
19 79.5 C 


27 62.8 
23 52.9 


23 84.6 C 
21 70.1 C 


27 61.0 C 

28 53.1 


3 


29 46.4 C 
19 36.1 


12 24.2 
33 33.2 


12 45.9 C 
29 43.9 C 


27 34.2 
7 34.8 


A 

■ ■■ - 


31 47.8 C 
16 48.6 C 


19 44.5 C 
29 34.3 


17 49.5 C 
30 41.2 


16 39.7 
25 A2.3 C 


5 


17 44.2 C 
30 29.7 


29 20.5 
16 17.9 F 


28 31.5 
16 20.3 


22 27.1 
20 27.0 


6 


19 33.8 
31 45.6 C 


28 32.3 
17 31.5 


29 42.4 C 
16 40.9 


7 29.7 
22 30.6 


7 




13 33.2 
24 40.7 







Test Level 
Red 
Green 
Brown 



Maximum Score 
90 
60 
60 



Floor (F) Effect Below 
27 
18 
18 



Celling (C) Effect Above 
63 
42 
42 



TABLE C.6 

MEAN RAW SCORES ON THE SDRT REPORTED BY CLASS 



site: OHIO 



GRADE 



School: COMPARISON 



SPRING 1977 



_H Jtean Ind 



22 
26 
9 



45.7 
46.7 
43.2 



20 78.8 C 
29 71.8 C 



35 44.5 C 



33 41.4 
10 53.7 C 



19 23.6 
18 28.0 



9 48.0 C 
34 36.1 



FALL 1977 



N Hean Ind 



16 35.5 
29 52.6 
9 41.2 



26 30.1 
16 32.4 



27 44.2 C 



35 21.6 



35 23.5 



SDRT TEST POI.'jTS 



SPRING 1978 
N Hean Ind 



29 43.3 



24 65.4 
36 78.4 



C 
C 



29 43.3 
15 49.0 



C 
C 



17 51.8 
10 46.3 



C 
C 



21 36.8 
U 17.2 



7 
23 



36.0 
29.9 



Tfisc Level 
Red 
Gceen 
Brown 



MaxlauB Score 
90 
60 
60 



FALL 1978 



N Hean Ind 



6 
11 

4 



49.5 
46.9 
37.0 



11 
17 
5 



25.3 
23.2 
37.2 



8 46.4 C 

8 37.1 

6 49.7 C 

5 45.0 C 



10 
3 
7 



22.1 
25.0 
22.8 



8 24.5 
14 26.7 
6 33.5 



Floor (F) Effect Below 
27 
18 
18 



SPRING 1979 



N Hean Ind 



FALL 1979 



N Hean Ind 



Celling (C) Effect Above 
63 
42 
42 



ERIC 
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TABLE C.7 

MEAN RAW SCORES ON THE SDRT REPORTED BY CLASS 



Site: TENHESSE8 School: SPECIAL EMPHASIS 



GRADE 


. SDRT TEST POINTS 


DDbrup laii 
arKlNu Lyfl 


VATT 1077 


SrRING 1978 


FALL 19/8 


SPRIKG 1979 


FALL 1979 


N Mean Ind 


N Mean Ind 


N Mean Ind 


N Henn Ind 


N Mean Ind 


N Mean Ind 


1 


21 36.2 
23 38.8 




a 60.7 
13 43.5 
21 61.1 




16 66.6 C 
22 56.2 




2 


24 64.2 C 

25 68.4 C 


22 44.7 
13 46.5 
7 33.3 


23 77.1 C 
13 83.1 C 
7 51.0 


23 64.2 C 
21 62.0 


22 84.3 C 
20 85.3 C 


33 67.4 C 
15 65.2 C 
18 69.3 C 


3 


19 40.1 
16 32.2 


6 15.1 F 
23 29.4 
23 32.8 


3 42.3 C 
19 46.7 C 
22 48.4 G 


23 31.0 
19 32.0 


23 40.1 
20 43.4 C 


22 42.4 C 
18 38.3 


4 


22 46.8 C 
20 42.6 C 
11 52.0 C 


21 33.9 
13 34.8 


21 47.8 C 
13 46.3 C 


26 47.6 C 
23 42.6 C 


29 52.0 C 
25 52.3 C 


23 41.7 
19 43.4 C 


5 


23 28.6 
9 20.0 

24 32.0 


11 16.8 F 
27 21.4 
16 18.1 


9 26.5 
27 26.4 
15 37.4 


9 25.0 
22 24.2 


12 34.7 
21 25.5 


23 25.2 
22 28.3 


6 


26 36.4 
24 31.6 

27 32.8 


28 25.0 
22 25.3 
6 12.0 F 


26 36.3 
23 32.8 
6 25.8 


20 34.3 
31 26.9 


'20 39.3 


12 33.5 
20 26.2 


7 




23 34.1 
18 38.7 
22 33.1 




43 33.3 




17 39.7 
30 36.4 



Test Lev el Haxlaum Score Floor (F) Effect Below Celling (C) Effect Above 
Red 90 27 63 
Gieen 60 18 42 
Broun 60 18 42 
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TABLE C.8 

MEAN RAW SCORES ON THE SORT REPORTED BY CLASS 



site: TENMBSSEE School: OOHPARISOH 



1 


SDRT TEST POINTS ^ 


SPRIHG 1977 


FALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FAIX 1979 


GRADE 


N Hean Ind 


N Mean Ind 


N Heaa Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


1 


17 45.0 
15 38.7 




15 23.1 
23 52.8 




19 42.8 
17 41.4 




2 


10 82.8 C 

11 67.8 C 
10 84.6 C 


6 39.5 
24 54.4 


4 77.5 C 
23 77.6 C 


20 61.6 


20 86.0 C 


28 49.6 

13 47.6 

14 50.1 


3 


5 24.0 
S 51.6 C 
8 40.2 


15 37.6 
17 27.2 


14 48. 3 C 
14 47.3 C 


19 31.5 
7 31.0 


17 46.5 C 
8 47.2 C 


IB 40.9 




18 52.2 C 
4 38.2 


16 37.4 
6 41.3 


16 53.4 C 
7 50.3 C 


11 48.2 C 
4 54.2 C 
15 40.1 


9 57.1 C 
5 53.2 C 
15 50.3 C 


13 45.3 C 
4 47.5 C 


5 


6 29.3 
10 18.2 
6 30.8 


8 25.2 
10 25.1 


8 34.7 

9 30.8 


13 23.9 
16 31.2 


15 37.5 
14 30.9 


7 35.4 
5 27.2 
14 26.9 


6 


12 27.5 
9 33.9 
12 36.4 


10 26.9 
14 28.4 


10 25.7 
14 40.1 


17 34.6 


19 40.4 


13 36.1 
11 37.2 


7 




21 35.4 
6 31.7 




23 34.7 




14 37.7 



Test Level Haxtmua Score F loor (F) Effect Below Celling (C) Effect Above 

Red 90 " 27 63 

Green 60 18 42 

Brown 60 18 A2 
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TABLE C.9 

MEAN RAW SCORES ON THE SDRT REPORTED BY CUSS 



site: TEXAS 



School: SPECIAL EMPHASIS 



SPRING 1977 



M Mean Ind 



25 
22 
25 
23 
20 



49.3 
52.2 
48.3 
54.1 
56.7 



23 78.6 C 

24 80.9 C 
24 79.7 C 
24 75.5 C 



I 44.2 C 
I 49.3 C 
27 47.1 C 



28 
25 
24 



54.3 C 
51.8 C 
48.8 C 



29 
26 
26 
25 



31.9 
34.7 
37.9 
27.0 



PALL 1977 



SDRT TEST POINTS 



H Mean Ind 



21 
22 
23 
23 
24 



51.1 
58.1 
54.3 
54.0 
65.0 



24 
24 
23 
22 



45.7 
33.3 
32.1 
38.6 



22 48.1 C 

22 51.4 C 

23 46.8 C 
22 44.2 C 



52 
52 
46 
25 



28.6 
30.3 
30.8 
27.2 



Test_Level 
Red 
Green 
Broun 



Haxlfflum Score 
90 
60 
60 



SPRING 1978 



N Mean Ind 



21 
23 
22 
23 
23 



77.9 
83.1 
78.0 
77.2 
82.2 



24 
25 
23 
18 



29 36.8 
26 36.3 
26 35.5 



C 
C 
C 
C 
C 



51.6 C 

39.5 

41.6 

47.0 C 



21 50.6 C 

22 53.9 C 

23 48.3 C 
19 51.2 c 



FALL 1978 



N Mean Ind 



21 
21 
20 
17 
19 



63.7 
59.8 
63,1 
55.0 
56,2 



25 
29 
27 
25 



37.3 
37.5 
38.7 
34.2 



21 49.2 C 

16 46.6 C 
26 52.9 C 

17 42.2 C 



13 25.4 

22 24.2 

39 36.0 

6 24.2 



26 36.0 
24 32.9 
18 30.2 



Floor it) Effect Be low 
27 
18 
18 



SPRING 1979 



N Mean Ind 



26 62.6 

24 59.4 

21 73.1 C 

19 65.3 C 



18 
19 
20 
IB 
19 



82.2 
84.5 
81.9 
84.4 
78.9 



C 
C 
C 
C 
C 



25 
31 
25 
28 



49.5 C 

47.3 C 

46.7 C 
41.6 



20 50.6 C 

17 51.2 C 

27 52.8 C 

14 51.6 C 



14 
27 
26 
20 



27.7 
36.2 

50.0 C 
28.9 



FALL 1979 



M Mean Ind 



18 68.2 C 

18 70.7 C 

18 71.7 C 

16 69.9 C 



18 
18 
19 
14 
18 



35.5 
43,7 
38.4 
39.8 
36.2 



23 48.8 C 

27 45.5 c 

25 45.0 C 

23 43.6 C 



16 30.4 

15 28.7 

18 35.9 

13 26.3 



15 27.5 

17 38.2 

22 48.9 C 

19 29.5 



Celling (C) Effect Above 
63 
42 
42 
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TABLE C.IO 

MEAN RAW SCORES ON THE SORT REPORTED BY CLASS 



Site: TEXAS School: COMPARISON 



GRADE 


jnim 1977 

N Mean Ind 


FALL 1977 
N Mean Ind 


SORT TE 
SPRING 1978 
N Mean Ind 


ST POINTS 
FALL 1978 


SPRING 1979 


PAT1 1Q70 
rnuii 17/7 


1 


21 58.3 
21 53.3 
2h 56.6 
21 59.0 
23 55.1 






N Mean Ind 


N Mean Ind 

31 75.9 c 
15 37.9 
23 57.0 
27 66.1 C 
18 43.9 


N Mean Ind 


2 


29 83.8 C 

26 78.5 C 

27 77.1 C 

30 85.9 C 
12 78.7 C 


26 59.6 
28 61.4 
28 61.3 
26 59.5 
14 36.3 


25 79.4 C 

25 79.4 C 

26 80.1 C 

27 78.6 C 
9 60.5 


34 81.3 C 

22 51.5 

26 75.9 C 
14 48.8 

23 55.6 
22 49.6 


30 88.2 C 
18 73.4 C 
29 85.3 C 
22 67.4 C 
25 80.7 C 
18 69.7 C 


25 77.8 C 
19 59.8 
21 67.2 C 
15 49.1 


3 


29 43.6 C 
29 42.4 C 
26 44.5 C 
28 46.5 C 


28 35.7 
21 43.0 C 
23 44.2 C 
26 36.9 
, 26 38.2 


25 47.1 C 

20 50.5 C 

21 48.2 C 
29 48.2 C 
25 47.7 C 


28 41.2 
17 25.6 
32 31.9 
34 49.0 C 


29 47.4 C 
18 39.4 
39 43.6 C 
28 53.8 C 


28 50.4 C 
18 30.1 
24 49;4 C 
13 26.9 
21 38.1 


4 


25 52.5 C 
25 49.7 C 
25 54.4 C 
23 51.6 C 
25 53.5 C 


25 46.3 C 
25 49.6 C 
27 47.2 C 
32 44.8 C 


25 51.9 C 

26 51.4 C 
31 48.9 C 
26 49.9 C 


33 36.7 C 

34 53.1 C 
27 46.4 C 
20 38.4 


32 56.3 C 
31 54.0 C 
28 49.7 C 
16 43.3 C 
5 49.6 C 


27 48.3 C 
13 40.0 I 
29 45.1 C 
25 55.8 C 


5 


2S 1A A 

31 34.4 
30 34.7 
28 38.5 


1 1 1*1 fx 

24 28.9 
26 28.0 
22 31.7 
50 35.8 
55 30.2 
26 37 9 


23 35.2 

21 37.4 

24 36.4 

22 43.0 C 
26 37.7 


29 27.9 
22 31.3 
28 29.4 

30 33.2 


29 29.9 
23 32.2 

25 33.7 

26 38.4 


25 41.2 
27 31.2 

26 25.2 
17 19.3 

5 21.8 


6 








17 37.3 

15 35.5 

16 35.3 

20 44.5 C 
2 2 34 .3 




24 31.6 
18 30.3 
23 28.3 
26 36.2 



T est Level 

Red 

Grsen 

Brown 



Haxlmun Score 
90 
60 
6C 



Floor (F) Effect Below 
27 
18 
18 



CetllnK (C) Effect 
63 
42 
42 



bove 
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TABLE Cll 

MEAN RAW JCORES ON THE SDRT REPORTED BY CLASS 



site; WEST VIRGIWIA School! SPECIAL EMPHASIS 



GRADE 


SDRT TEST POINTS 


SPRING 1977 


FALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FALL 1979 


N Mean Ind 


N Mean Ind 


N Hean Ind 


N Hean Ind 


N Mean Ind 


M Hean Ind 


1 


25 39. 7 




1 A SO ^ 
iH JC.I 

22 50.2 
26 60.3 




24 45.7 
24 52.8 
24 51.0 




2 


21 55.0 
31 83.8 C 


29 56,9 
21 31.1 


32 83.5 C 
23 70.0 C 


40 69.0 C 
24 43.0 


40 84.4 C 
39 71.7 C 


21 47.6 
23. 5J,8 
24 51.7 


3 


30 49.6 C 
20 28.1 


27 37.5 
26 17.7 F 


26 50.4 C 
24 38.4 


32 42.1 C 


33 52.5 C 


31 45.5 C 
7 30.4 


4 


33 53.5 C 
26 17 J 


28 50.5 C 
23 20.9 


33 53.9 C 
13 41.2 


26 50.0 C 

27 34.8 


27 54.5 C 

28 45.6 C 


30 53.1 C 


5 


24 22.3 
27 32.5 


32 29.6 
29 18.5 


35 35.9 
12 26.2 


11 38.4 
11 38.2 


11 49.3 C 
11 45.4 C 


14 38.9 


6 


30 4 3.5 C 

31 19.0 


29 37.5 
31 18.8 


32 47.5 C 
14 35.7 


24 29.0 

25 34,8 


23 38.7 

24 41.2 


20 36.6 
14 36.6 


7 




34 40.3 
29 20.9 




33 25.6 
31 45.7 C 




31 35.1 
30 42.7 C 



^_Level Maxlmua Score Floor (F) Effect Below Ceiling {Q Effect Above 

Red 90 27 ^^3 ' ' 

Green 60 18 42 

Brown 60 18 42 



ERIC 
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TABLE C.12 



MEAN RAW SCORES ON THE SDRT REPORTED BY CL/iSS 



site: WEST VIRGINIA 



Schoo l: COMPARISON 



SPRIHC 1977 
H Mean Ind 



31 
26 



44.0 
40.5 



19 

25 



43.9 
78.7 



25 39. B 
22 35.4 



27 42.4 
25 44.7 



41 33.1 
15 18.9 



26 41.7 
28 23.1 



Teat Uvel 

Green 
Brown 



C 
C 



_PAU 1977 



W Mean Ind 



30 
29 



24.3 
49.8 



27 27.1 
23 26.1 



18 45.7 
29 36.7 



25 23.6 
27 19.3 



21 25.4 

21 28.1 

V 25.7 

29 39.1 

25 17.0 




SPRING 1978 



SDRT TEST POINTS 



N Mean Ind 



30 
25 



38.2 
49.7 



32 63.6 
35 75.2 



C 

c 



28 37.2 
19 48.8 



19 55.1 
24 45.8 



C 
C 



25 34.9 
29 28.2 



22 
19 
20 



36.6 
41.8 
35.6 



FALL 1978 



M Mean Ind 



21 47.7 
7 72.8 
26 46.8 



26 
28 



30.1 
23.7 



SPRING 1979 



N Mean Ind 



18 
16 



43.7 
46.5 



22 72.5 C 
7 85.8 C 
27 62.5 



23 42.6 
25 32.7 



25 
26 



46.3 
33.7 



26 
27 



32.7 

23.9 



25 
24 



29.1 
30.9 



I 



32 43.7 C 



22 50.3 
26 38.0 



28 
24 



38.3 
27.0 



23 
21 



34.9 
34.1 



JALL 1979 



N Mean 



19 
14 



42.0 
51.8 



19 30.1 
8 47.6 
23 29.2 



23 
18 



41.8 
34.6 



21 
22 



27.5 
22.1 



24 
23 



35.8 
31.4 



19 36.4 
17 39.3 



Floor (P) Effect Below 
27 
18 
18 



Cgtl' ng (C) Effect Ahnvp 
63 
42 
42 
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TABLE C.13 

MEAN RAW SCORES ON THE SDRT REPORTED BY CUSS 

tf-- 



site: CALirORHIA Schools SPECIAL EMPHASIS 



GRADE 


SDRT TEST POINTS 


SPRING 1977 


FALL 1977 


SPRING 1978 


FALL 1978 


SPRING 1979 


FALL 1979 


N Meao Ind 


H Mean lad 


N Mean Ind 


N Mean Ind 


N Mean Ind 


N Mean Ind 


1 






24 60.1 
12 81.2 C 




14 64.3 C 
20 64.0 C 




2 




10 44.5 
27 70.2 C 


13 77.1 C 
25 79.7 C 


13 60.8 
27 65,4 C 


13 79.3 C 
24 82.8 C 


11 74.4 C 
14 76.1 C 


3 




26 37.0 


26 47.8 C 


27 31.4 
9 42.2 C 


26 38.1 
12 45.0 C 


13 40.7 
18 38.0 






27 50.7 C 
7 34.1 


22 52.8 C 
7 51.4 C 


15 37.7 
17 46./ C 


19 42.4 C 
19 50.2 C 


21 36.8 
10 46.3 C 


5 




31 25.7 
16 18.5 
15 33.3 


15 26.7 
14 37.3 


11 35.4 
23 33.2 


9 41.2 
22 32.8 

■ 


14 23.6 
14 27.7 


6 




U 43.? C 
21 25,1 


9 49.9 C 
16 35.0 


36 31.2 


4 46.7 C 
29 39.6 


7 46.1 C 
19 38.5 


7 








21 37.7 




13 19.5 



Test level Maxlmua Score Floor ( F) Effect Below Celling {Q Effect Above 
Red 90 27 63 
Green 60 18 42 
Brown 60 18 42 
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TABLE CJ4 

MEAN RAW SCORES ON THE SDRT REPORTED BY CUSS 



Site: CALIFORNU 



School: COMPARISON 



SDRT TEST POINTS 



GRAl 



SPRIHG 1077 



N Mean Ind 



eit Uvel 
led 
Creea 
Brown 



FALL 1977 



W Mean Ind 



23 67.6 

24 58.7 

24 37.9 

28 25.7 



28 59.1 
10 40.6 



15 15.8 
27 19.0 
10 25.2 



17 28.6 
31 23.4 



Haxiwii Score 
90 
60 
60 



SPRING 1978 



N Mean Ind 



14 38.0 
18 40.8 



25 79.9 

23 85.2 

21 47.6 

20 43.3 



C 
C 

C 
C 



FALL 1978 



N Mean Ind 



21 47.4 
11 41.8 



14 15.4 
30 22.8 
8 37.4 



12 36.7 
28 34.3 



25 
13 



40.2 
47.8 



29 33.6 
15 44.0 



29 39.1 
27 41.4 



26 25.6 
13 26.7 



33 25.3 
15 22.0 



Floor (F) Effect Below 
27 
18 
18 



SPrJNG 1979 



N Mean Ind 



19 61.2 

11 69.5 

26 48.8 

14 45.3 



G 
C 



23 46.4 
25 45.4 



C 
C 



30 
13 



24.5 
31.1 



29 26.1 
14 28.2 



FALL 1979 



N Mean Ind 



5 67.0 C 

3 87.7 C 

10 24.5 

11 25.4 



7 44.6 C 
7 51.1 C 



15 
17 



20.3 
19.5 



9 19.3 
16 34.3 



3 20.7 



Ceiling (C) Effect Ahoif# 
63 
42 
42 
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APPENDIX D 

FP^QUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION 



D-1 
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TABLE D.l 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Slta: LOUISIANA 

School: SpaclAl. EvphMla 



Frolact Yaar 1977-78 



SPRING 1977 


Grada 


Total 
atudanca 
cascad 


No. >1 yr 
balow 
trada 


X of cocal 
>X balow 
«rada 


1 


47 


N/A 


N/A 


2 


42 


7 


17X 


3 


36 


8 


22Z 


4 


53 


30 


57X 


5 


35 


22 


632 


6 


53 


31 


592 


TOTAL 


266 


98 


37X 


Slca: LOUISIANA 
School: Coaparlaon 


SPRING 1977 


Grada 


Toeal 
atudaata 
caicad 


Mo. >1 yr 
balov 
trada 


Z of total 
>X yr balov 
urada 


1 


135 


N/A 


N/A 


2 


lU 


21 


19X 


3 


86 


20 


23Z 


4 


136 


72 


53Z 


5 

> 


92 


57 


62Z 


6 


130 


72 


55X 


TOTAL 


690 


242 


35Z 



SPRING I 


977 TO SPRING 197 8, 


Grada Grada 

Spr 77 Spr 78 


Total atudants 
taatad at 

both polatt 


No. >1 yr 
balov grada 

Spr 77 


No. >1 yr 
balov grada 

Spr 78 


No. >1 yr 
at both poinrs 


1 1 
1 2 


5 
27 


N/A 
N/A 


N/A 
3 


N/A 
N/A 


2 2 
2 3 


2 
30 


2 
5 


0 
8 


0 
4 


3 3 
3 4 


1 
26 


1 
4 


0 
U 


0 
4 


4 4 
4 5 


9 

34 


9 
15 


8 
18 


8 
13 


5 5 
5 6 


5 
25 


4 
16 


2 
16 


2 
14 


f 6 


13 


12 


9 


9 













Projact Taar 1977-78 



SPRING 1977 TO SPRING 1978 


Grada Grada 

Spr 77 Spr 78 


Total atudaata 
taatad at 

both points 


Jfo. ->1 yr 
balov grada 

Spr 77 


No. >1 yr 
balov grada 

Sor 78 


No. >1 yr 
balov grada 

St both polaes 


1 1 
1 2 


22 
76 


N/A 
N/A 


N/A 
8 


N/A 
N/A 


2 2 
2 3 


9 
69 


4 
7 


2 
9 


2 

7 


(Not avalU 


ila dua to codln 


; arror) 






4 4 
4 5 


9 

81 


8 
40 


8 
52 


8 

37 


5 5 
5 6 


1 
67 


1 
38 


1 

35 


1 
32 


6 6 


\ 


0 


1 


0 


1 











Excluding students designated as having learning problems. 



EST A.^ 



J. com 
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TABLE D.2 ' 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Pro1«et Y««r 1978-7^ 

Sle«: LOUISIANA 

School: Sp«elai. EmphMla 



GtMdm 


- § 

local 
•cuduic« 

CMCQd 


>KMC 197 8 
Mo. >1 yr 
b«low 


X of tocal 
^1 yr btlov 




Gr«d« Grsdt 

Sfv 78 Spr 79 


SPRING I 
Tocal acudtncj 

both Doinca 


978 TO SPRING 
Mo. >1 yr 
bftlow grsdit 
Sor 78 


1979. 
ito. >1 yr 
bolow (r«d« 

Sor 79 


No. >1 yr 
btloir (rada 
AC boch polnca 




40 


K/A 


H/A 




I 2 


26 


N/A 


4 


M/A 




36 


3 


n 


2 2 
2 3 


1 

29 


0 
2 


0 
7 


0 
2 




45 


13 


29Z 


3 3 
3 4 


5 

27 


5 
3 


2 
9 


2 
2 




44 


26 


59Z 


4 4 
4 5 


3 
30 


3 
17 


2 
21 


2 
17 




42 


20 


48X 


5 5 
5 6 


3 
35 


1 
15 


0 
17 


0 
15 




U 


33 


69X 


6 6 


11 


11 


7 


7 


TOtAL 


255 


95 


37X 















Prolacc Ta« 1978*79 

Sico: LOUISIANA 
School: Co«p«ri«oa 



Gradft 


S 

TOCAi 

scudancfl 

UU8<I 


*m6 W^a" 

Mo. >1 yr 
boiov 


X of eocAl 
>X yr b«lov 




Crado Grsdo 

Spr 78 Spr 79 


_ SPWNC ; 

TocAl acud«ac« 
coacod AC 

_b4th poinca 


.978 TO SPRING 
Mo. >1 yr 
boXov grad* 
Sor 78 


1979 

No. >1 yr 
balov grade 

Sor 79 


Mo. >1 yr 
balcv grada 

AC boch oolnea 




U6 


M/A 


M/A 


1 1 
1 2 


22 
66 


M/A 

K/A 


M/A 

3 


N/A 
M/A 




112 


13 


12X 


2 2 
2 3 


24 
63 


5 
3 


1 
10 


1 
3 




88 


15 


17X 


3 3 

3 ^ 4 


1 

70 


0 
8 


0 
24 


0 
8 




96 


49 


5U 


^ 5 


64 


30 


43 


29 




100 


65 


65X 


5 5 
5 6 


6 
67 


6 

40 


6 
40 


6 
38 




86 


48 


56X 


S 6 


4 


4 


3 


3 


TOTAL 


598 


190 


32{ 













Excluding students designated as having learning problems « 



BEST MAILJ.nm COPY 



D-3 

S93 



TABLE D.3 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



SIcb: LOOISIAHA 

Schcal: Special EophMls 



SPRING 1979 


6rad« 


Toc«X 
flCudsnCfl 
. CSflCtd 


No. >1 yr 
balow 
Kra.ia 


1 Z of cocal 
>1 yr balow 
grada 


1 


44 


N/A 


M/A 


2 


36 


4 


UX 


3 


43 


10 


23Z 


4 


41 


14 


34Z 


5 


40 


25 


63Z 


6 


55 


27 


49Z 


TOTAL 


259 


80 


3IZ 


Sic«: LO0ISIAHA 
School: CoDparlflon 




SPRING 1979 


Grada 


Tocal 
■Cudeacfl 
ceacad 


No. >1 yr 
balov 
arade 


Z of cocal 
>1 yr balow 
2rada 


i 


106 


N/A 


N/A 


2 


lU 


3 


7Z 


3 


91 


17 


19Z 


4 


91 


35 


39Z 


5 


92 


64 


70Z 


6 


105 


65 


62Z 


TOTAL 


598 


189 


32Z 



Excluding students designated as having learning problems. 



D-4 




TABLE D.4 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



SiM: XICBICAH 

School: Spadal Eaphuii. 



Ptolaet Y««r 1977-78 



SPRDfC lv>?? 


Crad* 


ToCAl 
CM cad 


No, >1 
bo low 
trado 


t oC cocoX 
>1 yr bolov 
rrado 




Ul 


V/A 


N/A 




U8 


22 


19Z 




92 


24 


26Z 




89 


49 


55Z 




105 


74 


712 




UO 


71 


65Z 


TOTAL 


625 


240 


38X 


Slct: .HICHIGAH 
School: Coap«ri«oa 


SPRING 1977 


Crada 


TotAl 
4Cudftncs 


No. >1 yr 
bolow 
uradii 


Z at coCaI 
>1 yr bolov 
cradA 




96 


H/X 


H/A 




78 


22 


28Z 




87 


21 


24X 




89 


49 


55X 




90 


76 


84X 




89 


62 


70X 


TOTAL 


529 


230 


UX 



SPRING 1977 TO SPRING 197fl. 


Grado Grado 

Spr 77 Spr 78 


Tocal acudoaca 
coacod ac 

boch polaca 


No, >1 yr 
bolov grado 

Sor 77 


No, >1 yr 
bolov grado 

Spr 78 


No, >1 yr 
bolov grado 
ac boch polaca 


1 1 
1 2 


6 
79 


N/A 
N/A 


N/A 

7 


N/A 
N/A 


2 2 
2 3 


3 
85 


2 
12 


3 
20 


2 
12 


3 3 
3 4 


1 
65 


1 
18 


0 
37 


0 
16 


4 4 
4 5 


2 
69 


2 
38 


1 
46 


1 
36 


5 6 


80 


57 


,7 


52 


6 6 


1 


1 


1 


1 












?roiocc Toar 1977-78 


SPRING 1977 TO SPRING 197* 


Ccada Grado 

Spr 7? Spr 78 


TocaI acudanca 
coacod ac 

boch points 


No, >1 yr 
boXev grado 

Sor 77 


No, >1 yr 
bolov grado 

Sor 78 


No. >1 yr 
bolov grado 

ac boch oolnca 


1 1 
1 2 


3 
59 


N/A 
N/A 


H/A 
7 


N/A 
N/A 


2 2 
2 3 


• 2 
54 


2 
10 


2 
U 


2 
5 


3 3 
3 4 


8 
56 


8 

10 


3 
25 


3 
9 


4 5 


66 


32 


52 


31 


5 6 


60 


47 


45 


44 


N/A 


N/A 


N/A 


N/A 


N/A 













Excluding students designated as having learning problems < 



BEST 



■ ■ 
O ii. 



D-5 



295 



1 



TABLE D,5 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 

Proiact Yaar 1978-79 

Stfi MICHIGAM 

School: Spttdal Eaphula 



s 


»RING 197a 






SPRING 1978 TO SPRUNG 


1979 




Grmds 


local 
acud«nta 


Mo. >1 yr 
balow 
srad« 


X jf coc«l 
>1 yr balov 




Groda Grada 

Spr 78 Spr 79 


Tocai tcuclanca 
CM cad ac 

boch polnca 


No. >1 yr 
balow grada 

Spr 78 


No. >1 yr 
balow grada 

Spr 79 


No. >1 j'r 
balow grada 
ac boch DOlaca 


1 


loa 


NM 


5/A 




1 2 


82 


H/A 


0 


N/A 


2 


Hi 


U 


UZ 




2 3 


90 


9 


12 


8 


3 


102 


23 


25Z 




3 3 
3 4 


5 
82 


4 
16 


2 
43 


2 

15 


4 


93 


54 


58Z 




4 5 


77 


44 


56 


42 


5 


90 


63 


70Z 




5 5 


2 


2 


2 


2 


6 


97 


69 


71Z 




N/A 


N/A 


N/A 


N/A 


H/A 


TOtAL 


605 


224 


37Z 















Slca: XICaiGAN 
School: Covparlaon 



Prolacc Taar 1978-79 



1 s 


^RIMC I9H 


1 Grada 


Tocal 
acudaacs 


No. >1 yr 
balow 
mda 


Z of cocaX 
>1 yr balov 
trada 




89 


N/A 


N/A 




99 


25 


25Z 


3 


84 


17 


20Z 


4 


77 


34 


44Z 




93 


72 


77Z 


6 


75 


57 


76Z 


TOTAL 


517 


205 


40Z 



SMTMC 1978 TO SPRmC 1974 


Grada Grada 

Spr 78 Spr 79 


Total actidaacs 
ca«cad ac 

. boch potaca 


No. >1 yr 
baXoir grada 

SPr 78 


No. >l yr 
bal«r grada 

Spr 79 


No. > 1 yr 
balow grada 

ac both DOinca 


1 2 


60 


N/A 


3 


N/A 


2 2 
2 3 


5 

71 


2 
10 


0 
U 


0 
5 


3 4 


66 


U 


38 


13 


4 5 


65 


32 


37 


29 


N/A 


N/A 


K/A 


N/A 


N/A 


M/A 


N/A 


S/A 


N/A 


N/A 













Excluding students designated as having learning problems. 



BEST A V' 



D-6 



ERIC 



^96 



TABLE D.6 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Stc«: MICHIGAH 

School: Sp«cl«l S^>hMta 





s 

TOCAl 


PRDIG 1979 
No. >X yr 
btXov 


X of cocal 
>1 yr btlow 


1 


94 


N/A 


N/A 


2 


106 


4 


4Z 


3 


U4 


22 


X8Z 


4 


106 


60 


57Z 


5 




80 


76Z 


TOTAI. 


535 




31Z 








-J 



SlCft: MICaiGAN 
School: CoaparlAon 





S 

total 
•tudenca 
caatad 


PRING 1979 
No. >1 yr 
balotf 
arada 


X of Cocal 
>1 yr balov 
gy*da 


1 


94 


M/A 


M/A 


2 


91 


7 


8Z 


3 


96 


19 


20Z 


4 


84 


50 


60Z 


5 


A4 


53 


63Z 


TOlAt. 


449 


129 


29Z 











Excluding students designated as having learning problems. 



D-7 
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TABLE D.7 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



sim: oaio 

School: Special Emphaal* 



Pto1«ct Y««r 1977-78 



5 


»»IMG 1977 


GvMdm 


TocaX 
scud«act 


No. >l yr 

bdiXov 
—IffiiS 


X ot local 

>l yr below 


I 


51 


H/A 


N/A 


2 


45 


8 


18X 


3 


48 


14 


29Z 


4 


47 


16 


34Z 


5 


47 


20 


43X 


6 


50 


20 


40X 




288 


78 


27X 



SPRING \ 


9n TO SPRING 1978, 


GrAdtt GcAdtt 

SfT 77 Spr 78 


local scudaacs 
CMCAd ac 

bocb polaca 


No. >1 yr 
balov grada 

Sor 77 


No. >1 yr 
balov irada 

Spr 78 


No, >1 yr 
balov 8r*da 
ac boch polaca 


1 2 


37 


N/A 




N/A 


2 3 


29 


6 


4 


4 


3 4 


39 


12 


20 


12 


4 5 


35 


9 


22 


9 


5 6 


35 


13 


13 


10 


N/A 


N/A 


N/A 


N/A 


N/A 













Slca: OHIO 
School: Coflparlaoa 



P rolacc Taar 1^ V7-»78 



SPRING li>7 


Grada 


local 
•cudancs 
caaca4_ 


No. >1 yr 

balov 
tSfitfS 


Z of COCal 
>1 yr balov 


1 


58 


N/A 


N/A 


2 


SO 


7 


:4z 


3 


35 


6 


17Z 


4 


43 


25 


S3Z 


5 ' 


37 


26 


70Z 


6 


43 


20 


47Z 


TOTAL 


266 


84 


32Z 



SPRING 1977 TO- SPRING 1978 


Grada Grada 

Spr 77 Spr 78 


local scudaaca 
caacad ac 

boch polncs 


No. >1 yr 
balov grada 

Spr 77 


No. >1 yr 
balov grada 

Spr 78 


No . > 1 yr 
balo%' g«Ttda 
ac boch Poln^j 


1 2 


40 


N/A 


3 


N/A 


2 2 
2 3 


1 
33 


1 
4 


1 
4 


1 
3 


3 4 


18 


2 


8 


2 


4 5 


28 


14 


17 


12 


5 5 
S 6 


1 
24 


1 
18 


1 
14 


1 
14 


N/A 


N/A 


N/A 


N/A 


N/A 













Excluding students de<;lgnated as having learning problems, 




D-8 



TABLE D.8 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



ProUce Y»ts 1977>78 

Slct: T£miBSSEE 

School: SptdAl EmphMls 



Gr«d« 


s 

TocaI 
scudaaca 


PmNC 1977 
No. >1 yr 
balov 


I of cocaI 
>1 yr balo^ 




Grada Gr«d« 

Srr 77 Spr 78 


SPRING 1 
Tocai scudaacs 
caacad as 

boch polncn 


977 TO S^i^TNG 
No. >1 yr 
IxLov grada 
5pT 77 


1578 

No. >1 JrT 

balow grada 

Spr 7S 


No. >1 yr 
balov grada 
ac boch polnta 




44 


N/A 


!f/A 


1 1 
1 2 


2 
33 


tr/A 

N/A 


N/A 
5 


N/A 
N/A 




49 


15 


31Z 




2 3 


40 


10 


9 


8 




35 


15 


43Z 


3 3 
3 4 


1 
27 


1 
11 


0 
16 


0 
10 




53 


27 


512 


4 5 


4 
42 


4 
20 


2 
28 


2 
18 




56 


36 


6hX 


5 3 
5 6 


3 
42 


3 
24 


3 
26 


3 
23 




77 


4« 


62X 


6 6 


5 


5 


5 


5 


TOTAL 


314 


141 


45Z 















Ftolact Taff 1977-78 

Slca: TENNESSSZ 
School: Coaparlsoa 



C>cada 


S 

ToCaX 
scudaacs 
caacad 


PMN« 1977 
No. >1 yr 
balov 
srada 


I of cocaI 
>1 yr balov 


1 


Grada Grada 

Spr 77 Spr 78 


SPRING ] 
TocaI scudaoca 
caacad aC 


977 TO. SPRIH5 
No. >1 yr 
bftloir grada 

Sor 77 


1978 

No. >1 yr 
balov grada 

Sor 78 


No. > I yr 
balov grada 




32 


N/A 


N/A 


1 1 
1 2 


CM 


N/A 
N/A 


N/A 
2 


ac boch pointfa 
N/A 
N/A 




31 


1 


3Z 


2 2 
2 3 


1 
21 


0 
0 


0 

0 


0 
0 




19 


8 


42Z 


3 3 
3 4 


2 
13 


Z 

3 


0 

1 I 


0 
1 




24 


11 


46Z 


4 4 
4 5 


3 
14 


3 ' 

4 


1 

7 


1 
4 


5 


22 


16 


73Z 


5 6 


19 


13 


12 


12 




33 


18 


55Z 


6 6 


1 


1 


0 


0 


TOTAL 


161 


54 


341 












* 













Excluding students designated as having learning problems. 



Best 



D-9 



ERIC 



^99 



TABLE D.9 



FREQUENCY ANALYSIS OF STUDENTS MOPE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Sica: TENNESSEE 

School: Special EapUasii 



Prolacc Y«ar 1978-79 



SPRING 1978 


Gradt 


Tot-%1 
icud«nca 
caacad 


No. >l yr 
balow 
srada 


Z of Cocal 
>1 yr balow 
srada 




43 


N/A 


N/A 


2 


43 


6 


14Z 




SO 


10 


20Z 


4 


34 


18 


53Z 


S 


52 


33 


64Z 


6 


55 


36 


66Z 


TOTAL 


279 


103 


37Z 


Sic«: 
School: 


nODIESSEE 
Ccoparlaon 




SPUING 1978 


Grads 


Tocal 
acudanca 
cat tad 


fto. >l yr 
baXow 
crada 


2 of cocal 
>1 yr balov 
crad9 


1 


38 


»/A 


S/A 


2 


27 


2 


71 


3 


28 


1 


4Z 


4 


23 


4 


in 


5 . 


17 


10 


59Z 


6 


24 


14 


58T 


TOTAL 


157 


31 


20Z 



SPRIiJG 1 


978 TO SPRING 197 9 


Grada Grada 

Spr 78 S5>r 79 


Tocal scudanca 
caacai at 

bocb Dolncs 


No. >i yr 
b&lov grada 
Spr 78 


No. >1 yr 
balov grada 

Sor 79 


No. >1 yr . 
balov grada 
ac boch polnca 


1 1 
1 2 


1 
34 


N/A 
N/A 


0 


N/A 
5/A 


2 2 

2 i 


2 

31 


2 
3 


0 
4 


0 ' 

1 


3 3 
3 4 


5 
37 


A 
2 


3 
7 


3 
2 


4 4 
4 5 


5 
25 


5 
12 


2 
16 


2 

9 


5 5 
5 6 


3 
14 


3 
6 


3 

- 5 


3 
5 


6 6 


11 


3 


3 


3 













Proiacc Taar 197B-7 Q 



SPRING 1978 TO SPRING 1979 


Grada Grada 

Spr 78 Spr 79 


Tocal acudanca 
caacQd ac 

boch polncs 


No. >1 yr 
balow grada 

Jor 78 


No. >1 yr 
balow grada 

Sor 79 


No . > 1 yr 
baJlow grada 
ac Doch 99laea 


1 1 
1 2 


5 
17 


H/A 
N/A 


M/A 
0 


N/A 
N/A 


2 3 


20 


1 


2 


1 


3 3 
3 4 


1 
23 


0 
1 


0 


0 
1 


4 5 


21 


3 


8 


3 


3 6 


18 


U 


9 


9 


N/A 


N/A 


N/A 


N7A 


N/A 












as havinj 


I learning problems 







D-IO 



oo 



TABLE D.IO 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION * 



Sict: TENNESSEE 

School: Special BmphMls 



SPRING 1979 


Gradt 


Toc«l 
tcud#ncfl 


No. >1 yr 
btXov 


X of cocal 
>1 yr btlov 




38 


N/A 


N/A 




42 


0 


0 




43 


7 


16Z 




54 


a 


20Z 




33 


20 


60Z 




20 


9 


452 


TOTAL 


230 


47 


2CZ 



Slca: TENNESSEE 
School: CoapATlson 



SPRING 1979 


Gr«dft 


Total 
scud«ncfl 


No. >1 yr 
btlotf 
Rradt 


Z of cocal 
>1 yr btlotf 
Rradt 


X 


36 


N/A 


N/A 


2 


20 


0 


0 


3 


25 


2 


8Z 


4 


29 


6 


2IZ 


5 


29 


13 


45Z 


6 


22 


U 


50Z 


TOTAL 


161 


32 


20Z 



Excluding students designated as having learning problcns. 




30i 



TABLE D.ll 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Slt«: TEXAS 

Sebool: Special SapbMit 



Projacc 1977-78 



SPRING 1977 


Gradft 


ToC«l 
•tudaacs 


No. >1 yr 
b«lov 
sr«d« 


X of tOCAl 

>1 yr bolow 
trado 


1 


U6 


N/A 


N/A 


2 


96 


/ 


71 


3 


81 


6 


n 


4 


79 


17 


221 


S 


106 


55 


52Z 


TOTAL 


478 


85 


18X 











SPRING 1 


977 TO SPRING 1978 i 


Grado Grad* 

Spr 77 Spr 78 


ToCAl scudaata 
ccscact It 
boch points 


No. >1 yr 
balov grada 

£or77 


NO. >1 yr 
balov grada 

Spr 78 


No. >1 yr 
balov grada 
at boch points 


1 2 


83 


N/A 


6 


M/A 


2 2 
2 3 


2 

63 


0 
4 


0 

.7 


0 


3 4 


61 


2 


12 


'^ 


4 5 


63 


13 


19 


10 


N/A 


N/A 


S/k 


N/A 


N/A 























Slca: TSZA8 
School: CoHpariaoQ 



Frolact Taar iq77-7» 



SPRIKS 1977 


Grada 


Total 
atudonts 
caacad 


Moc >1 yr 
bilov 
*;ada 


X of total 
>^ yr bdlov 
trada 


1 


uo 


M/A 


N/A 


2 


124 




3Z 


3 


U2 


17 


15% 




124 


31 


25Z 


3 


U4 


49 


43Z 


13DTAL 


384 


101 


17X 











SPRING 1977 TO SPRING 


1978 


Grada Grada 

Spr 77 Spr 78 


Total scudanta 
castad at 

both Dola»L 


No. >1 yr 
balov grada 

3or 77 


No. >1 yr 
balov grada 

Sor 78 


No, > 1 yr 
- balov Qradii 
at both points 


1 2 


71 


N/A 


3 


N/A • 


2 2 
2 3 


1 

90 


1 
0 


0 

4 


0 
0 


3 3 
3 4 


2 

79 


i: 


1 
26 


1 ' 
10 1 


4 3 


89 


19 


30 


r 

16 ! 


3 3 


2 


1 


1 


I j 










! 
i 










! 



Excluding students designated as having learning problems, 



•1 V ±^-~. 



FX 



D-12 

302 



TABLE D.12 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 

Pro1«ct Y««r lOTB-T^ 

Slea; TEXAS 

School: Special Eaphula 





1 Toc«l 
•cudMCa 


?RING 1978 
No. >1 yr 
balov 


X of cocaX 
>1 yp balov 
srada 




Grada Grada 

Sft 78 Spr 79 


SPRING 1 
local acudanca 
caatzad ac 

boch polnca 


978 TO SPRING 
No. >1 yr 
balov grada 
Spr 78 


m9_^ 

No. >1 yr 
balow grada 

Spr 79 


No. >1 yr 
balov grada 
ac boch polnca 


1 




n/k 


M/A 




N/A 


U/A 


n/k 


* H/A 


N/A 


2 


114 


7 


6Z 




2 3 


81 


1 


6 


1 


3 


90 


U 


12Z 


3 4 


32 


3 


14 


3 


4 


85 


22 


26Z 


4 3 


57 


12 


15 


8 


S 


81 


28 


35Z 


H/A 


N/A 


N/A 


N/A 


N/A 


TOTAL 


370 


68 


18X 






























J 



Prolacc Taar 197B>79 

Slca: TEXAS 
School: Coaiparlaon 



f 

r 

Gradvi 


S 

1 TOCAI 

lacudanca 
Lett cad 


PRING 1978 
No. >1 yr 
balov 
trada 


Z of cocal 
>1 yr balov 
ftrada 




Crad« Grada 

Spr 78 Spr 79 


SPRING ] 
Tocal acudanca 
caaead ac 

boch polnca 


379 TO SPRINt 
No. >L yr 
b%lov gsrada 
Spr 78 


1979 

No. >1 yr 
balov grtda 

Sor 7«> 


No. >1 yr 
balov grada 

4t boch poinca 






N/A 


N/A 




N/A 


S/A 


N/A 


N/A 


N/A 




113 


9 


8Z 




2 2 
2 3 


5 
70 


3 
4 


0 
6 


0 
2 




U2 


8 


71 




3 3 
3 4 


7 
84 


3 
2 


1 
19 


1 

? 




109 


37 


34Z 




4 4 
4 3 


3 
74 


3 
23 


3 
30 


3 
19 




U6 


37 


32Z 




5 3 


4 


4 


3 


3 


TOTAL 


463 


91 


20Z 



































Excluding students designated as having learning problems. 




D-13 



303 



TABLE D.13 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION * 



Stfi TEXAS 

School: . SptdaX Emphula 



SPRING 1979 


Gridt 


Total 
aeudanta 

CMCttd 


No. >1 yr 
btlov 
tradt 


X ot cocal 
>1 yr balov 
trada 


1 


90 


N/A 


N/A 


2 


95 


1 


IZ 


3 


109 


U 


lOZ 


4 


78 


23 


30Z 


5 


87 


32 


37Z 


TOTAL 


459 


67 


15Z 











Sica: TEXAS 
School: Cooparlaon 



SPRING 1979 


Grada 


Tocal 
acudanca 
caatad 


Mo. >1 yr 
baloir 
trada 


Z of cocal 
>1 yr balotf 
arada 


1 


U4 


N/A 


N/A 


2 


142 


9 


6Z 


3 


U4 


10 


9Z 


4 


U2 


30 


27Z 


5 


104 


45 


43Z 


TOTAL 


586 


^ 94 


16Z 











Excluiding students designated as having learning problems. 
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TABLE D.14 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Siea: NEST mciRU 
School: Sp«el«l SaphMt* 



ProUcc YoT 1977-7« 



1 s 


»RINC 1977 






Hp. >1 yr 


Z ot CqsaI 
nails 


I 


52 


Bl/A 


N/A 


2 


52 


10 


19X 


3 


50 


13 


26X 


4 


S9 


23 


39X 


5 


51 


35 


69X 


6 


61 


36 


59X 


TOIAL 


325 


U7 


36X 





SPRING \ 


977 TO SPRING 


1978 - 




Spr 77 Spr 78 


TQtAi a Sudan 
caaead ac 

bach Dolno 


Nq. >1 yr 
bslov grada 

Sor 77 


No. >I yr 
balov grada 

Spr 78 


Nq, >1 yr 
baXov grada 

laj«**W t^m.4w^mm 


1 . 2 

f 


U 


N/A 


3 


N/A 


2 2 
2 3 


1 
43 


0 
8 


0 
6 


0 
« 


3 3 
3 4 


1 
38 


0 
5 


0 
12 


0 
5 


4 5 


52 


18 


25 


14 


5 6 


44 


29 


16 


16 






N/A 


N/A 


N/A 













Prolact Yaar I9y7>78 



sita: UI8T vncnru 

School: Coapariaon 



t 




Grada 


Tocal 
acudaaca 
cticad 


No. >1 yr 
baloif 
«r«da 


Z of Cecal 
>l yr balo< 
trtda 


1 


58 


N/A 


N/A 


2 


44 


14 


32S 


3 


47 


13 


32Z 


4 


52 


26 


50Z 


5 ? 


56 


35 


63Z 


6 


54 


34 


63Z 


TOIAL 


3U 


124 


40Z 



SPRING 1977 ra SPITNC 


l47i 


Grada Grada 

Spr 77 Spr 78 


tocal aciidanca 
caacad ac 

both oolaca 


No. >1 yr 
balotf grada 

Sor 77 


No. >1 yr 
balov grada 

Sor 78 


No. >1 yr 
balov grada 

4C boch oolnM 


1 2 


52 


H/A 


8 


N/A 


2 3 


33 


12 


8 


7 


3 4 


36 


8 


9 


6 


4 4 
4 5 


1 
39 


1 
17 


1 
19 


1 


5 6 


46 


29 


20 


20 


N/A 


N/A 


N/A 




N/A 













Excluding students designated as having learning problems. 



BEST AVAi 
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TABLE n.l5 



FREQUENCY ANALYSIS OF STULJiNTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Stea: WEST VIKGINIA 
School: Spael4l EaphMU 



'Pto1«ef Y««r 



s 


PFINC 1978 




Tocai 
•cudancj 


No. >1 yr 
bftlov 


Z of tOC4i 

>X yr balov 
nrada 




72 


N/A 


M/A 




55 


3 


6X 




SO 


10 


20X 




46 


15 


33Z 




61 


31 


5U 




57 


21 


37X 


TOTAL 


341 


80 


24X 



SPRING 197flT0 SPRING 1979 


Grtdo Grado 

Spr 78 Spr 79 


Total atudanta 
taacad ac 

both points 


No. >1 jrr 
balov grada 

Sor 78 


No. >1 yr 
balow grada 

Sor 79 


No. >1 yr 
balov grada 
at both polnta 


1 1 
1 2 


1 
68 


N/A 
N/A 


n/a 

3 


N/A 
N/A 


2 3 


52 


4 


16 


4 


3 4 


41 


7 


16 


7 


4 5 


46 


16 


19 


14 


5 6 


55 


26 


28 


19 


N/A 


N/A 


N/A 


N/A 


N/A 













Projact Ytar 1978-79 



Slca: VEST VUGIHU 
School: CMparlaon 



SPRING 1978 


Grada 


Total 
atudanta 
tantad 


No. >1 yr 
balov 
arada 


X of total 
>1 yr balov 
«rada 




55 


M/A 


N/A 




67 


15 


22S 




47 


12 


26X 




43 


11 


26X 


5 ^ 


54 


30 


56X 




61 


30 


49X 


TOTAL 


327 


98 


30X 



SPRING 1978 10 SPRING 197* 


Grada Grada 

Spr 78 Spr 79 


Total acudaaca 
taacad at 

both points 


No. >1 yr 
balov grada 

Sor 78 


No. >1 yr 
balov grada 

Sor 79 


No. >1 yr 
balov grada 
ac both ooloca 


1 2 


48 


N/A 


9 


N/A 


2 2 
2 3 


10 
40 


0 
9 


0 

16 


0 
7 


3 4 


40 


10 


21 


10 


4 5 


38 


13 


17 


11 


5 6 


35 


18 


18 


17 


N/A 


N/A 


N/A 


N/A 


N/A 













Excluding students designated as having learning problems. 



BEST A^, 
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TABLE D.16 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 

\ 

Slc«: WEST VIRGINIA 
School: Sp«el«l EmphMis 





SPRING 1979 


Gradt 


Total 
ctscttd 


No. >1 yr 
osxov 


Z of cocal 
>1 yr btlov 


1 


72 


N/A 


N/A 


2 


79 


4 


5Z 


" 3 


59 


22 


37Z 


4 


55 


23 


42Z 


5 


58 


27 


47Z 


6 


68 


38 


56Z 


TOTAL 


391 


U4 


29Z 



Slct: WEST VIRGINU 
School: Co«p«rlson 





SPRING 1^7 9 


Gradft 


TocaX 


Ho, >1 yr 
i&lov 


Z of cotal 
>X yr balov 


1 


35 


N/A 


N/A 


2 


66 


14 


21Z 


3 


48 


19 


40Z 


4 


48 


24 


50Z 


5 


52 


27 


52Z 


6 


44 


23 


52Z 


TOTAL 


293 


107 


37Z 



* 

Excluding students designated as having learning problems. 
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TABLE D.17 

FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



Stea: CALIF08MU 
School: Spael«l Eaphaata 



SPRINC 1978 




ToCAl 
iCudsnts 


Mo. >1 yr 
below 
<rad« 


Z of total 

>1 yr bslov 


1 


36 


H/A 


H/A 


2 


39 


2 


5Z 


3 


29 


3 


lOZ 


4 


29 


6 


21X 


5 


32 


19 


39X 


6 


30 


17 


57X 


TOTAL 


195 


47 


24t 


Sic«: CALZFOSNIA 
School: Coaparlflon 


SPRXKC 1978 


1 Tocal 
GraJft Iscudantit 
1 CAS cad 


No. >1 yr 
bdlow 
tradft 


I of eocal 
>1 yr b«law 
xrad* 


1 


32 


H/A 


N/A 


2 


48 


2 


4Z 


3 


46 


5 


UX 


4 

1 


32 


21 


66t 


3 


52 


38 


73J 


6 


51 


36 


71Z 


TOTAX, 


261 


102 


39t 



Prolact Yaar 1978-"79 



SPRINC 1 


978 TO SPRING 197 9 


Grada Grada 

Spr 78 Spr 79 


Total aCuilAnca 
eaa cad ac 
boch polnea 


No . >1 yr 
balov grada 

Sor 78 


No* >1 yr 
balow grada 

Sor 79 


no ■ yr 
belov grada 
ae boch poincs 


1 2 


23 


N/A 


1 


N/A 


2 3 


29 


1 


S 


1 


3 4 


21 


2 


14 


2 


4 5 


22 


4 


9 


4 


5 6 


19 


10 


8 


8 


N/A 


N/A 


N/A 


N/A 


N/A 













Proiacc Taar 1978^79 



SPRING 1978 TO SPRING 197 9 


Grada Grada 

Spr 78 Spr 79 


Tocal scudaacs 
Caacad ac 

boch DOlnca 


No. >1 yr 
baiow gra^a 

sor 78 


No. >1 yr 
balow grada 

Spr 79 


No. >1 yr 
balow grada 
ac boch Dolncs 


1 2 


18 


N/A 


6 


N/A 


2 3 


27 


1 


2 


0 


3 4 


30 


4 


17 


4 


4 5 


15 


8 


9 


7 


5 5 
5 6 


2 
24 


2 
18 


2 
17 


2 

15 


N/A 


N/A 


N/A 


N/A 


N/A 













Excluding students designated as having learning problems, 
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TABLE D.18 



FREQUENCY ANALYSIS OF STUDENTS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION* 



SlC«: CALIFORNIA 
School: SpselU EmphMls 





Grads 


TocaX 
■tudaatfl 

trgmfd 


No, >1 yr 
bsXov 
xrada 


X of cocal 
>1 yr baXov 


1 


34 


M/A 


N/A 


2 


37 


1 


3Z 


3 


39 


8 


2U 


4 


38 


23 


6U I* 


5 


31 


14 


45Z 


6 


33 


13 


39Z 


TOTAL 


212 


59 


28Z 



Sice: CALIFORNU 
School: Coaparlflon 



SPRING 1979 



Grade 


Total 
a cudanca 
ceatad 


Mo. >1 yr 
balov 
arada 


X of cocal 
>1 yr balov 
gg*da 




10 


N/A 


N/A 




36 


11 


31Z 




64 


23 


36Z 




48 


23 


48Z 




44 


30 


68Z 




43 


34 


79X 


TOTAL 


245 


121 


49Z 



Excluding students designated as having learning problems. 



ERIC 
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APPENDIX E 
ANALYSIS OF COVARIANCE - WHOLE GRADE 
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TABLE E.l 



IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
WHOLE GRADE 



DEFEHUDIT VARIABLE: ,?DHI Coapr«h«aoloii local Poaccaac 
ScmXad Seora 

IHDEPESDB9T VARIABLE: Traacatnt 

COVARIAXE: SDIX Coaprahanalon local Prec ise 

Sealad Seora 

Slta; LOOISIAHA 



AECOVA 


























0 M 










■ 






a a 










fi a 
a a 


i 






a 


s s 






a 




a u 


■a s 


u 






1 










u 

8 




> a 


^ 3 




• 

u 


TraacaaftC 


CO 
0 

• 

i 


• CO 

u 

8^ 

s «a 


U 4i 

3 3 

■ a 9 

J 0 8 
a £ ca 


•a u 

2 S 
S S 8 

«-i a o 

4 £ ca 


i 
m 


a- 

«• 0 




.7c 

a 

V 

O 0 


3 flu 
U 0 


^ a 


2 


Spadal Sapbaala 
Coapadaoa 


29 
85 


257 
298 


338 C 
35X C 


366 

341 


9.28 


<0.0l 




1.5 
1.9 


2.3 
2.4 


+ .8 
+ .5 


3 


SpaciAl E^haala 


31 


330^C 


422 


443 


o.n 


0.40 




2.2 


3.3 


+1.1 




Coapariaoa 


69 


367 c 


447 C 


437 








2.6 


3.8 


+1.2 


4 


Spaelal Eaphaaia 


37 


* 

4U 


442 C 


440 


3.30 


0.59 




3.2 


3.7 


+ .5 




Coaparifloa 


91 


416* 


458 C 


435 








3.2 


4.1 


+ .9 


5 


Special Eaphaaia 


39 


467 C 


502 


497 


5.53 


0.02 




4.3 


5.4 


+1.1 




Coapariaoa 


82 


46XC 


470 


472 








4.2 


4.4 


+ .2 


6 


Spaeial Eaphaaia 


38 


466 


500 


5X7 


9.52 


0.47 




4.3 


5.3 


+1.0 


1 


Go^ariaoa 


68 


493 


5X9 


509 








5.1 


5.0 


+ .8 



^Pracaac fall 1977. 

C isdicacaa chac corraaponding maan raw acora above 70Z corracc (calling) • 
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TABLE E.2 

niPACT SUMMARY FOR PROJECT YEAR 1978-79 
WHOLE GRADE 

DEPSKDSn VAIUBIZ: SOU Coi|^t«lMasloa TocaX Posttatc 
Sc«X«d Seora 

IHD8PSSDEBT VARIABLE: Traatasnt 

OOVARIAXE: SDtX Coaprshtaslon Totsl ?r«c«tt 

SeaUd Seort 

SICK lomsuHk 





AV007A 








i 


Tfatamat 


a 

1 

0 

i 


a 

:s 
II 


3 S 

^ M !• 


1 

m m 

1 M a 

9 M S 
«-i a Q 

4 a* « 


s 


a 

a" 




a M 

h 

ca a 


a u 


il 

u 

m a 

c 

es 


2 


Coayarlsoa 


90 


256 

3U 


346 C 
364 C 


372 
357 


4.19 


0.04 




1.5 
2.0 


2.4 
2.6 


+ .9 
+ .6 


3 


Special Eaphaala 
Coi^ansott 


34 
64 


343 C 
370 C 


421 
448 C 


437 
440 


0.09 


0.76 




2.4 
2.6 


3.3 
3.8 


+ .9 
+1.2 


4 


Spaelal EophMla 
CoBparison 


30 
70 


426 

446 C 


465 C 
481 C 


477 
476 


0.00 


0.93 




3.4 
3.8 


4.3 
4.7 


+ .9 
+ .9 


5 


SpadaX b^hasla 
Coapaclson 


33 
70 


457 C 
461 C 


490 

46'- 


494 
464 


6.78 


0.01 




4.1 
4.2 


5.0 
4.3 


+ .9 
+ .1 


6 


Spaelal lopbaala 
Coflparlaoa 


46 

71 


495 
478 


540 

507 


529 
514 


1.97 


0.16 




5.1 
4.6 


6.6 
5.5 


+1.5 
+ .9 



C Indlcacaa chat corraapondlas raw acora abova 70X corracc (calling). 



TABLE E.3 

IMPACT SUMMARY FOR PROJECT YEAR 1977-79 
WHOLE GRADE 

f *fff! > i 1 f r 7A1XABLS: SOKI Coapx«h«iialfla ToCal PoflCcaaC 
Sealad Scan 

XBDSFKBDgOT 7AMXMMlSi Tmamc 

GOVAUJOXt son CooprahaoaioQ TotaX PrataaR 

Sealad Seora 

Sitag LOOISim 













1 

o 


TraaOMi^ 


a 

u 
a 

i 

m 

a 
• 

i 


£: 
ll 


i! 

72 8 
hi 


h 

Is 

^ £ « 


1 


1 

%« 

a- 

« 0 




h 


IS 

a u 

}i 


i 

'•a 

ji 


3 


Spaalal taphaala 
Goflyariaoo 


30 
61 


236 

307 


419 
443 C 


452 
426 


6.U 


0.02 


1.3 
2.0 


3.3 
3.7 


K.8 
fl.7 


4 


Sprittial )itepbaala 
CoapariaoA 


28 
63 


333 C 
374 C 


471 C 
466 C 


463 
461 


0.01 


0.89 


2.3 
2.7 


4.4 
4.9 


►1.9 
►2.2 


5 


Special Si^baaia 
Coapaxlaoa 




210 AV 


UXSZS P 


eSIBLE 








j 




6 


Spadil MmhaMtM 
Co^arlaoa 


39 
64 


460 C 
467 C 


531 
507 


537 


6.03 


0.02 


4.1 
4.3 


6.3 
5.5 


-►2.2 
-fl.2 



C ladicacaa chat corzaapostdlac Biaa vm aem abova 70Z corraet (calUag) . 
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TABLE E.4 



IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
WHOLE GRADE 



OUfUUW VAIZABLE: 

ZBDIPKBDIIIT VA&IABU: 
OOVAIXAXSx 



SOU Cofl9t«htta«lon tot«I ?ocrcasc 
Sc«Xtd Score 



Site; MICKIGAH 



SDKT CoaprthenalQ^ TotiU. Irrcecac 
Scaled Score 









i 

1 

TteaoMttt 


e 

m 

1 

M 

«l 

0 
i 


** e 

It 

•i ^ 

:^ 


*S 

s: 

J 8 3 

a Ai OS 


a a 

73 3 

4 a* «» 


3 


a- 

VI - 0 




a u 

i* 

IM 
C9 0 




« 

n 


2 


SpeeiAi laphaela 


82 


299 


352 C 


348 


0.65 


0.42 




1.9 


2.4 


+ .5 




CoB{>arlaoa 


61 


288 


340 C 


344 




1.8 


2.3 


+ .5 


3 


SptclAl taphaala 


86 


345 C 


427 


428 


3.37 


0.07 




2.4 


3.4 


+1.0 




Coipaneoa 


64 


H6C 


419 


419 






2.4 


3.3 


+ .9 


4 


Special iaphaala 
Coflparlaoa 


67 
56 


422 
439 C 


449 C 
465 C 


456 
457 


0.06 


0.10 




3.3 
3.6 


3.9 
4.3 


+ .6 
+ .7 


5 


Special l^haolo 
Coopartoott 


69 
66 


456 C 
449 C 


453 
446 


450 
449 


O.OO 


0.93 




4.0 
3.9 


4.0 
3.8 


0 

- .1 


6 


Special l^haala 
Coaparlaoa 


81 
60 


461 
443 


495 
479 


488 
488 


0.00 


0.93 




4.2 
3.7 


5.1 

4.7 


+ .9 
+1.0 



C ladlcacft chac earr.ti>OBd^ mua r«f seor. abov. 70% corr.cc (coLXlng). 
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TABLE E.5 



IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
WHOLE GRADE 



OBFBHUHI 7ARXABU: 

XSDETEHDSNT VA&IASIS: 
COVAIZAXE: 



SDSI Conpnbuulon local PoaccMC 
Scaled Score 

Treacaenc 

SDBI Conprehenaion toteX Prececc 
Se^iid Scort^ 



Sice; MICHIGAy 



AHCOVA 












e 














a w 


a ■ 


1 






w 

a 


Hi 




II 








e e 


|S 

e w 


u 






1 


23 








CI 

s 




5-8 

a •> 

|i 

;a 0 


> m 

^£ 








w 

09 


g« 


• 

• • 


28 








» 0 




9 
U 


Treecaeae 


«4 

0 

i 


«• ^ 

s| 


3 e 
*n « • 

^ M S 
« « 0 

0 O CI 

3 flu fin 


^ m o 

^ flu 0) 




a- 

CO 0 




2 


Special laphaeia 


82 


290 


362 C 


360 


L.04 


0.31 




1.3 


2«6 


+ .8 




Coflperlaoa 


65 


283 


353 C 


355 








1.8 


2.5 


+ .7 


3 


Special Eaphaeie 


95 


350 C 


429 C 


426 


S.82 


0.02 




2.4 


3.4 


+1.0 




Coaperlaen 


71 


342 C 


435 C 


439 








2.3 


3.6 


+1.3 


4 


Special Caphaaia 


82 


431 


463 C 


459 


Oc99 


0.32 




3.5 


4.2 


+ .7 




Coaperiaon 


66 


422 


448 C 


454 








3.3 


3.8 


+ .5 


5 


Special Saphaaia 


79 


448C 


447 


453 


6.40 


0.01 




3.8 


3.d 


0 




Co^arlaoa 


65 


460 C 


481 










4.1 


4.7 


+ .6 



C ladlcscu chac corrMponding mmaa raw acor* Above 70X correcc (ceiling). 
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TABLE E.6 



IMPACT SUMMARY FOR PROJECT YEAR 1977-79 
WHOLE GRADE 



aUWm VASZABU: 



SttK MICglCAW 



SOBS Covpntbtcsloa Total ?otttMt 
Scalod 3coro 

trttatanac 

SSIS Coaprohoooipa Total Fra.:ost 
Sealod SeoxA 



iflOOTA 



1 

M 


TtMtman 


o 

u 
m 

«« 

0 

i 


w 0 

^3 
II 


n 

1 3 8 

a £ M 


X « 

SS8 


1 
m 


I 

g 

OS 0 


3 


SpociaX X^haala 
Cottparlaoa 


74 
52 


297 
292 


430 C 
436 C 


429 
438 


2.0C 


0. 15 


4 


SpoeiaX lai^baala 
Co^arlaca 


77 
53 


348 C 
350 C 


46C C 
450 C 


461 
448 


3.02 


0.09 
0.15 


5 


Spoelal Eopbaala 
CoBpavliaott 


63 
60 


418 
435 C 


448 
472 


458 

472 


2.14 



n 


0 a 


s 


a 8 






a at 

;3 0 


C3 0 


€S 


1.9 


3.5 


+1.6 


1.8 


3.6 


+1.8 


2.4 


4.1 


+1.7 


2.U 


3.9 


+1.5 


3.3 


3.9 


+.6 


3.6 


4.5 


+.9 



C Indleat.! chat corraspondlng imii& rm seor. Mbo^r. 70Z 3rr.cc (c:elllng) . 
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TABLE E.7 

IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
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C Indicacaa chac correapoadlng nean rau score above 70Z correct (ceiling). 
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IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
WHOLE GRADE 
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C ladlcacaa thac corraaponding oaaa rav scora abova 70X corracc (caillng). 
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IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
WHOLE GRADE 
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C indicacaa ehat corraapondl&g aaaa rav acora abova 70Z corracc (calling) . 
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IMPACT SUMMARY FOR PROJECT YEAR 1977-79 
WHOLE GRADE 
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C IndlMUs chat cerrMpondlne Man raw aeora abova 70t corract (calling) 
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TABLE E.ll 



IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
WHOLE GRADE 
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C Indleacu chac eorreapondlng man car scora above 70Z eomec (calling) . 
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IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
WHOLE GRADE 
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Preceat feU 1978. 

C indicates that corresponding mean raw score above 70X correct (ceiling) . 
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I>IPACT SUMMARY FOR PROJECT YEAR 1977-79 
WHOLE G5ADE 
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C iodlcataa thac corraaponding oaan vmt acoxa abova 70Z corrace( calling) . 
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TABLE E.14 

IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
WHOLE GRADE 
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C Indlcataa thmt corrMpondlBg man rav acora abova 70Z corraec (calling) . 
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TABLE 5.15 



IMPACT SUMMARY FOR PRO0£CT YEAR 1978-79 
WHOLE GRADE 
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C lndl(?«c«s Chat norrsspoadlng Man rnr aeon abova 70X corract (calllnj) , 
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TABLE E.16 



IMPACT SUMMARY FOR PROJECT YEAR 1977-79 
WHOLE GRADE 
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IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
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^Prataac faU 1977. 

C indlcaCaa chat corraapoading aaan rav acora abova 70Z corracc (calling). 
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IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
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<0.01 




Coi^arlam 


27 


365 C 


452 C 


454 






4 


SpadaX Saphaai« 


22 


UO C 


459 C 


451 


0.11 


0.75 




Coaparlaon 


30 


419 C 


449 C 


455 


5 


Spaelal fiaphaaia 


22 


489 C 


517 


496 


0.08 


0.77 




Coaparlaon 


17 


437 C 


4^4 


491 






6 


Spaelal Eaphasla 


19 


491 


560 


534 


1.79 


0.19 




Csaparlaon 


24 


435 


482 


504 







II 
1' 

* 1 
i* 


1 


1 

i 8 


to IM 
U 0 




II 


2.2 


2.9 


+ .7 


1.6 


2.0 


+ .4 


2.6 


3.3 


+ .7 


2.6 


3.9 


+1.3 


3.7 


4.1 


+ .4 


3.3 


3.9 


+ .r? 


5.0 


5.9 


+ .9 


3.6 


4.2 


•f .6 


5.0- 


7.2 


+2.2 


3.6 


4.8 


+1.2 
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ERIC 



TABLE F.l 



IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



BCPSBDSHT VASZABLE: SDBX (ioapctthsasion Total Foacrtaat 
Scftlad Scora 

IBDEPDIDEirr VARIABLE: Tnataan^ 

C0VAKIA3S: 8DBT Coaprahanaioa Total Pracaat 

ScAlad Scora 

Slta: LOUISIAHA 



AMCOVA 






•s 
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Traatarat 


• 

u 

a 

i 

u 

CO 

o 

i 


u « 
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S" 

c£ 
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a 

«3 

^ M 

• ■ 

3 9 
^ u « 

i « p 

e o 3 

s at OS 


Adjuscad Mean 
Poatteat Scaled 

Score 


% 

a 

> 

On 


Significance 
of P 




Grade Rquivalent 
of Mean Pretest 


ss m 
a « 

a 4i 
> « 

^ o 
3 £ 
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|l 

U «M 

C9 O 


Change In Grade 
Equivalent 


2 


Special Efflpfaasla 
Cospazi'l.aon 


13 
43 


230 
273 


326 
325 


368 
312 


X9.2 


<0.0l 


1.2 
1.7 


2.2 
2.2 


+1.0 
+ .5 


3 


Spacial Eophaala 

Cooiparlaoix 


13 
37 


294 

331 


379 
418 


403 
409 


0.51 


0.48 


1.9 
2.2 


2.7 
3.2 


+ .8 
+1.0 


4 


Spaclal Eaphasla 
Coaparlfloa 


19 
51 


377* 
379* 


413 
419 


414 
4X8 


0.13 


0.71 


2.7* 
2.7* 


3.2 
3.3 


+ .5 
+ .6 


5 


Spttdal Eapbaala 
Conparlaon 


21 
46 


429 
418 


455 
423 


446 
427 


2.34 


0.13 


3.4 
3.3 


4.0 
3.3 


+ .6 

0 


6 


Spadal Emphaala 
Conparlaon 


21 
41 


428 
441 


473 
462 


482 
458 


2.85 


0.10 


3.4 
3.7 


4.5 
4.2 


+1.1 
+ .5 



*Pracest Fall *77. 



TABLE F.2 



IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
STUDENTS BELOW GRADE MEAN 



DKPBuam r vauasle: 

ZHDI?SHDEST VAUABLE: 
COVAEZAXE: 



SD8X Cooprthuuion total PotttMt 
Sealed Score 

Treetmnt 

SOU Coaprehenelon Totel Preceet 
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«2 
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<^ 41 e 
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a** 


u 
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i 


i& 


a Q o 
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2 


Specie! Eapheeie 
Cooperleoii 


12 
40 


203 
284 


322 C 
339 C 


361 
327 


6.05 


0.02 


3 


Speeiel Eapheeie 
CoBperleon 


18 
31 


321 C 
341 C 


411 C 
418 C 


427 
409 


2.39 


0.13 


4 


Specie! Sapbeeie 
Cosperleoii 


15 

34 


402 
410 C 


451 
442 


459 
439 


4.01 


0.05 


5 


Specie! Eapheeie 
CoapeTleon 


18 
37 


421 C 
410 C 


442 
414 


438 
415 


7.51 


<0.01 


6 


Specie! Eapheeie 


26 


432 


474 


470 


7.07 


0.01 




Coaperleon 


40 


421 


439 


441 







44 

0 44 
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4 

e 


2 S 


a 41 
> a 


u 

41 
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1 


a e 
^ a 

|s 

. a «4 
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€S 


Q 
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1.8 


2.3 


+ .5 


2.1 


3.2 


+1.1 


2.3 


3.2 


+ .9 


3.0 


3.9 


+ .9 


3.1 


3.7 


+ .6 


3.3 


3.7 


+ .4 


3.1 


3.2 


+ .1 


3.5- 


4.5 


+1.0 


3.3 


3.6 


+ .3 
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TABLE F.3 



IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



vmmm vakza.us: 

XHDXPSHQEUT VA^XiBU: 
OOVAtZAXSs 



son Coiiprthaxifllon total Poattaat 
Scala4 Seora 

Traacatnt 

SDH C^at^rahanalon local Pracaat 
SealTid Scott 



Sita: MICaiGAH 



AHCOVA 


i 

u 


Tra&taanc 


m 

e 

1 

u 
CO 

tM 

0 
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i 
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a« 

a* 'o 

1^ 


3*8 
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s: 
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J3 
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ss 
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s 
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2 


Spaeial K^haala 
CoBparlaosi 


39 
31 


271 
261 


J28 
314 


326 
317 


1.59 


0.21 


3 


Spadal Cophaala 
Coapartaon 


46 
31 


314 
313 


394 
405 


394 
406 


5.57 


0.02 


4 


r((taelal Eaphaals 
Cottparlaoa 


37 
28 


394 
403 


423 
432 


427 
h27 


0.00 


0.95 


3 


SpaelaX Caphaala 
CofVarlaon 


40 
32 


416 
4U 


412 
410 


410 
412 


0.06 


O.SO 


6 


Spadal Eophaala 
Comparlaoa 


41 
29 


413 
391 


451 
430 


447 
435 


0.74 


0.39 
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ll 
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1.5 


2.2 
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3.1 
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3.0 
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3.5 


+ .4 
+ .5 


3.2 
3.2 


3.2 
3.1 


0 

+ .1 


3.2- 
2.9 


3.9 
3.5 


+ .7 
* .6 
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TABLE F.4 

IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
SrJDENTS BELOW GRAD2 MEAN 



»EBSE»T VARIABLE: 



SBBX Co^nhaasion Toeal Poattaac 
Sealad Scora 



ZHDEFiraSM VARIABLE: Traataaac 
0C7ARIA3B: 



SDBT CoBprahanalon Total Pracaac 
Scalad Scora 



Slca: MICHIGAK 
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Spaelml tiophaala 


40 


261 


348 


348 


2.52 


0.12 




Coaparlaoa 


26 


243 


334 


334 




3 


SfMclMl Saphaala 


52 


324 


410 


406 


2.18 


0.14 




Coflparlaon 


40 


315 


410 


415 






4 


Spadal Eaphaaia 


45 


396 


422 


423 


0.01 


0.91 




Covpartaoa 


34 




425 


423 






S 


Spacial fiaphaala 


42 


414 


406 


410 


4.44 


0.04 




Gooparlaeii 


35 


422 


438 


433 







44 


a m 
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i 

u 
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*g 
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•-4 

l> 

a 9 
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1.5 


2.4 


+ .9 


1.4 


2.3 


+ .9 


2.2 


3.1 


+ .9 


2.1 


3.1 


+1.0 


3.0 


3.3 


+ .3 


3.0 


3.4 


+ .4 


3.2 


3.1 


- .1 


3.3 


3.6 


+ .3 
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TABLE F.5 



IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



QEPSaSCfl VASIABLE: 

XHOKPENDSaX VARIABLE: 
OOVAEIAIE: 



Slt«! OHIO 



SPBX Comprehuslon tocal PosctMC 
Scaled Scora 

traataant 

SP8X Comprahanaloa total Pracaac 
Sealed Scora 







ANCOVA 
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e 
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Adjusted Mean 
Poatteat Scaled 

Score 


3 

s 


Significance 




1 

o a 

*^ a 
a u 

> o 

•a 

1"* 
1* 

u e 


Grade Equivalent 
ot Hean Poatteat 


Change in Grade 
Bqulvalent 


2 


Spadal Saphaala 


20 


282 


336 


329 


0.22 






1.7 


2.3 


+ .6 




Cosparlaoii 


21 


264 


318 


325 




1.6 


2.1 


+ .5 


3 


Special Gfflphaala 
CoBparlaoa 


17 
14 


320 
316 


418 
406 


417 
408 


1.00 


0.33 




2.1 
2.1 


3.3 
3.1 


+1.2 
+1.0 


4 


Spaclal Eaphaala 


19 
9 


390 
414 


410 
434 


418 
418 


0.00 


0.97 




2.9 
3.2 


3.1 
3.5 


+ .2 
+ .3 


5 


Spadal Ea\9haala 


20 


434 


415 


4U 


1.93 


0.17 




3.5 


3.2 


- .3 




Cooparlaoii 


16 


47;4 


436 


441 . 




3.4 


3.6 


+ .2 


6 


Special Kapbiaaij 
CoBparlaon 


18 
14 


464 
415 


516 

4A7 


502 
465 


4.52 


0.04 




4.2 
3.2 


5.8 
3.8 


+1.6 
+ .6 
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TABLE F.6 

IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



ncTsnmrr vaszable: 

IHDKPCSDENT VAKIABLE: 
GOVISIATE: 



Scaled Score 
Treacaent 

SDH Coaprehenslott To eel Pretest 
Scaled Score 
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A9C0VA 
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8« 
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s 


a- 


u 
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i 


l» 

S CO 
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^ • 0 
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a* 
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2 


Special Saphaala 
Conparltoa 


17 
11 


243 
244 


322 
333 


323 
333 


D.71 


0.41 


3 


Special Eapbaii2^ 
Cooparleon 


21 
14 


304 
346 


393 
444 


418 
405 


Q.77 


0.39 


4 


Special Baphaela 
Coaparlfoa 


18 

7 


384 
400 


430 
467 


432 
460 


3.96 


0.06 


5 


Special Eaphasla 
Coiparlaoa 


23 
8 


407 
444 


432 
468 


438 
449 


3.36 


0.55 


6 


Special Efliphaela 
Coaparlsoa 


27 
10 


419 
380 


449 
446 


443 
462 


).97 
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S O 

|l 


u 
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&1 
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1.4 


2.3 


+ .9 
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2.9 


+ .9 


2.4 


3.7 


+1.3 


2.8 


3.4 


+ .6 


3.0 


4.3 


+1.3 


3.1 


3.5 


+ .4 


3.7 


4.4 


+ .7 


3.3 


3.9 


+ .6 


2.8 


3.8 


+1.0 
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TABLE F,7 



IMPACT SUMMARY FOR PROJECT YT!.Jl 1978-7:) 
STUDENTS BELOW GRADE MEAN 



OEPEHDBirr VARIABLE: 

IHDSPEBDSKT VAEIABIS: 
COVASZAXE: 



Sif; TENNESSEE 



SDBI Conpr«htto«lon local Poaccaac 
ScaXad Scora 

Xraacaanc 

SDRZ Cooprahanalon local Pracaac 
Scalad Scora 
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Significance 
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2 


Special Efflphasla 
Coaparlaon 


16 
10 


277 
286 


365 
371 


366 
369 


0.04 


0.84 


3 


Spaclal Efflphasla 
Co^arlaon 


18 
12 


321 
333 


401 
472 


405 
425 


2,7( 


0,11 




Spaclal Eophaala 
Coaparlaott 


25 
14 


418 

4:<o 


455 
470 


458 
464 


0,35 


0.56 


5 


Spaclal Eopbaaia 
Co^ariaon 


15 
12 


420 
461 


429 
479 


455 
446 


0,13 


0.68 


6 
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GofliparlaoQ 
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3.5 
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3.3 
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.7 


3.5 


4.4 


+ .9 


3.3 


3.4 


+ .1 


4.2 


4.7 


+ .5 


3.7 


4.7 


+1.0 


3.5 


4.6 


+1.1 
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TABLE F.8 

IMPACT SUMliARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



DSPEROBSI VASIABLE: 

IHDEPQtDEST VA&IABLZ: 
GOVARIAIE: 



SDBI Covprtthmalon tccml PosctMt 
Sealed Score 

TreACaent 

son CoaprehAtttion TdCAl Preceet 
ScAled ^^core 
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42 
37 
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334 
332 


339 
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4.45 


0.04 


3 


SpeclAl EaphAAlA 

COBpATlAOtl 


33 
49 


333 
348 


419 
436 


427 
431 


D.45 


0.52 


4 


SpAciAl EaphAAlA 
CoapATlAoa 


34 
47 


430 
4X6 


460 
458 


452 
464 


1.86 


0.18 


5 


SpAdAl EaphAAlA 
CoapAxlAon 


33 
49 


456 
456 


483 
482 
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482 


9.02 
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3.6 


+1.2 


3.4 


4.1 


+ .7 


3.2 


4.1 


+ .9 


4.0 


4.8 


+ .8 


4.0 


4.8 


+ .8 
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TABLE F.9 

IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
STUDENTS BELOW GRADE MEAN 



xssnsBm VA&XABLS: 

ZHDSFENDEBT VARIABU: 
GOVARZAXE: 



Sift TEXAS 



SDBZ Covpnhazisloa XocaX Potctcst 
Scaled Scort 

TrMCaaat 

SDBX Covprfthsoflioa Tocal Prtttsc 
Sealed Scora 
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40 
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1.8 
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Coflpariaon 


55 


296 


339 
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1.9 


2.3 


+ .4 


3 


S^aciAl Empbuia 


40 


339 


436 - 


428 


0.02 


0.88 




2.3 


3.4 


+1.1 




Cooparlaoa 


41 


342 


430 


429 








2.3 


3.5 


+1.2 


4 


SpaclAl Efflpbaala 


28 


417 


454 


461 


1.04 


0.31 




3.2 


4.0 


+ .8 




Comparison 


46 


434 


4&1 


456 








3.5 


4.2 


+ .7 


5 


Spaeial Bmphaais 


28 


448 


490 


485 


2.99 


0.09 




3.8 


5.0 


+1.2 




Comparison 


41 


440 


455 


459 








3.7 


4.0 


+ .3 



338 



F-10 



TABLE F .IO 

IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



OBFERDSNT VABIABLE: SDBX Coapnhaiuioa Total Postttsc 
ScAled Scort 

IBDSPCBDENT VARIABLE: TrMCatat 

OOVAHZAZE: SDH Cosprahtnsloa Total Prectsc 
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2 


Spttclal Esphuls 


20 
30 


229 
246 


335 
331 


338 
329 


3.27 


0.60 


1.2 
1.4 


2.3 
2.2 


+1.1 
+ .8 


3 


Spaelal Baphaais 
CoaparlMn 


25 
20 


316 
282 


435 
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425 
412 
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0.30 


2.1 
1.7 


3.6 
3.0 


+1.5 
+1.3 


4 


Spaelml EaphMls 
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21 
19 


409 
378 


447 
456 


433 
471 


5.04 


0.03 


3.1 
2.7 


3.8 
4.0 


+ .7 
+1.3 


5 


Spseial Eaphatia 
Co^ariaoa 


30 
19 


426 
400 


456 
430 


447 

a5 


3.02 


0.89 


3.4 
3.0 


4.0 
3.4 


+ .6 
+ .4 


6 


Sp«elAi Eaptuals 
Coapariaon 


20 
27 


417 
429 


513 
486 


518 
482 


S.12 


0.02 


3.2- 
3.4 


3.7 
4.9 


+2.3 
+1.5 



339 

F-11 



TABLE F^ll 

IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
STUDENTS BELOW GRADE 14EAN 



OKPSBOOff VASXABLK: 

IBDBFBKDEHT VAStZABLS: 
OOVAIIME: 



SXatZ Coiprttbsnslon toc«l Posccmc 
8gaI«4 Scor« 

SDXT CsaprahAttSion tocal Pratasc 
Scala4 Scora 



SicarWEST VTRCIMIA 



ABCOVA 




• 


• 
















0 






a a 










•3 

3 


u a 
a u 

2 8 


^ CO 

a 






a 

u 

s 






ca 


S" 


w u 














a* ^ 


S * 

3 a 
^ u a 


a a 
w a 


3 




9 




0 




^ u b 
a a 0 


a u « 

9 u te 

a 0 






s 


Traacatnc 


i 




S £ ea 


5 o « 
< a« ca 




CO. 0 


2 


Spaelal Kaphaaia 


30 


264 


338 


335 


0*52 


0.47 




CoaparlaoQ 


34 


255 


341 


343 






3 


Spadal Eaphaala 


27 


327 


389 


372 


12.3 


<0.01 




Cooparlson 


25 


297 


404 


422 






4 


Spaelal Eaphaaia 


22 


409 


459 


450 


9.82 


<0.01 




Coaparlaon 


23 


392 


403 


412 






5 


SpaciAl Emphaal« 


26 


439 


466 


457 


0.59 


0.45 




Coaparlaou 


19 


422 


457 


470 






6 


Spaelal Saqphaals 


29 


446 


490 


488 


10. 1 


<0.01 




Covparlaon 


22 


440 


446 


449 







S u 

a a 

•2 a 
a u 

> a 

3 0* 

1* 

U 0 


u u 

0 a 

a a 

a u 

Cd 0 


Change in Grade 
Equivalent 


1.6 
1.5 


2.3 
2.3 


+ .7 
+ .8 


2.2 
1.9 


2.9 
3.1 


+ .7 
+1.2 


3.1 
2.9 


4.1 
3.0 


+1.0 
+ .1 


3.6 
3.3 


4.3 
4.1 


+ .7 
+ .8 


3.8 
3.7 


5.0 
3.8 


+1.2 
+ .1 
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TABLE F.12 

IMPACT SUMMARY FOR PROJECT YEAR 1977-78 
STUDENTS BELOW GRADE MEAN 



Sltt CAtlTOMflA 



OEPmOir VAKXABLE; 

ZHDmODn VAEIASLS: 
OOVARZAXB: 



SOtt CoapxttkMMlon Toeal Posccmc 
Sealtd Seort 

Trtacauic 

SDir Coaprthanalon Total Pr«co«c 
Sealtd Scon 









• 
















a 


ti 


1*3 












i 


23 


•J w 


i& 




§ 






CO 






^ ** 




o 






<M 

0 




38 


it 


i 


•M 


i 








^ M O 

i • q 


IS s 




a*" 


u 


TroAcatac 


i 




a o S 

a At CA 


• 0 

4 At 01 


m 


CQ 0 


2 




17 


280 


336 


344 


0.08 






Covparison 


20 


300 


354 


347 


0.77 


3 


r^pocial Eavhasia 


14 


374 


407 


407 


0.87 


0.36 




CoBparlaon 


19 


363 


390 


390 






4 


Spadal S^haais 


15 


418 


461 


459 


10.6 


<0.01 




CoflparlaoB 


13 


406 


420 


423 






5 


Spadal lapbaala 


14 


390 


417 


418 


0.67 


0.42 




Co^arlaoa 


28 


382 


402 


402 






6 


Spadal lapbaala 


14 


421 


477 


471 


1.02 


0.32 




Coaparltoii 


22 


392 


451 


455 













a M- 


a • 


i 


• « 


• <i 


w 






a e 
• 

l> 


» 0 


C9 0 




1.7 


2.3 


+ .6 


1.9 


2.5 


+ .6 


2.7 


3.1 


+ .4 


2.6 


2.9 


+ .3 


3.3 


4.2 


+ .9 


3.1 


3.3 


+ .2 


2.9 


3.2 


+ .3 


2.8 


3.0 


+ .2 


3.3 


4.6 


+1.3 


2.9 


3.9 


+1.0 
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TABLE F.13 



IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
STUDENTS BELOW GRADE MEAN 



XHOIFODEST VAftXABLX: 
COVAIZAXBs 



SOir Co^rabMUlon Toeal PoattMt 
ScAlad Scoxm 



Slf! CALIFOMtIA 



TrMC 

SOtt Coaprthansloa TotmX PraCMC 
Sealed Scona 



AHCOVA 


i 




2 

1 

m 

0 
« 

1 


II 
11 


i: 

duo 


Is 

f W O 
^ « 0 

4 «• 01 


1 
m 


B" 

.IN <M 

M .0 


2 


Coaparltoft 


14 
9 


298 
244 


367 
290 


330 
349 


0.52 


0.48 


3 


SpadaX EaphMlt 


13 
15 


333 
341 


387 
440 


390 
433 


12.4 


<U.01 


i 


SpeelAl EaptiMia 
CoBpATlson 


13 
U 


409 
375 


432 
416 


426 
423 


0.11 


0.74 


5 


Spaelal EapbAtla 
CoHparlaoa 


U 
8 


459 
396 


486 
438 


459 
475 


0.18 


0.67 


6 




10 
12 


434 
381 


488 
U2 


485 
445 


1.47 


0.24 



a u 


u u 




9 9 


a 9 

9 9 

-in 


i 


i" 

: 8 

O 0 


U 0 


H 

U 

S 

0* 


1.9 


2.6 


+ .7 


1.4 


l.S 


+ .4 


2.3 


2.8 




2.3 


3-7 


+1.4 


3.1 


3.5 


+ .4 


2.7 


3.2 


+ .5 


4.1 


4.9 


+ .8 


3.0 


3.6 


+ .6 


3.5 


4.9 


+1.4 


2.8 


3.7 


+ .9 
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APPENDIX G 
METHODOLOGY 



This appendix describes the activities undertaken by ORG in the 
conduct of the second and third years^ of data collection and the 
analysis of data collected over the 3 years of the Special Emphasis 
Project evaluation study. This summary of study methodology and pro- 
cedures is presented in six parts including discussions of: 

• Ins trumentation 

• Data Collection Procedures 

• Problems in Data Collection 

• Data Preparation and Reduction 

• Preliminary Data Examination 

• Data Analysis Procedures and Issues 

INSTRUMENTATION 

Two major types of data were required to perform the process and 
impact evaluations required in this study: 

• Data and information about the teachers and the student 
populations in the participating schools and educational 
practices employed in these schools. 

• Data to be used in assessing the impact of the Special 
Emphasis Projects on the students and schools where these 
projects were implemented. 

In several cases, a single instrument was used to collect data 
for both of these purposes. Instruments used in this study, and the 
evaluation component for which data in each instrument were used, are 
summarized in Table 6.1. 



First year data collection was performed by the original evaluation 
contractor. Applied Management Sciences, Inc. 



TABLE G.l 
STUItY INSTRUMENTS AND USE(S) 



1^ ■ — 

Ins trumenc 


Use 0 
Process 
_ S tudy 


f Data 
Impact 
S tudvl 


1. The Stanford DiaKnostic Rftadin? Test (SDRT) 




X 


2. The Classification of Teaching Practices 


X 


X 


3. Prolect Director Questionnaire 


X 




4. Experimental School Principal puaationnalre 


X 


X 


5. Comparison School Principal Questionnaire 


TC 


X 


6. Reading Specialist Questionnaire I v 




7* Experimental School Classroom Teacher Questionnaire 


X 


f ! 

X } 


8. Comparison School Classroom Teacher Questionnaire 




X f 


9* Librarian Questionnaire 


X 




10. Student (Grade 3) and Student fGradea 4-6) Questionnaires 




X 


11. Parent Questionnaire 




X 


12. Student Information Checklist 


X 




13* Classroom Observation Protocol 


X 





(Copies of all Instmments used in this study are contained in 
Volume II of this report.) 

Instruments 1 through 11 (in Table G.l) had been selected and/or 
developed by the original evaluation design contractor and originally 
cleared by the Office of Management and Budget (0MB) for use in only 
the first year data collection. 

The Student Information Checklist — which sought demographic 
information on students in the participating schools — was developed 
by the original study contractor and USOE during the first year of this 
study but was not used in the first year data collection activities. 
The Student Information Checklist and instruments 1 through 11 were 
submitted to 0MB by USOE prior to the award of the continuation con- 
tract to GRC. These instruments were again cleared for only 1 year. 
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During the collection of data for the second year of the Special 
Emphasis Project, GRC identified several limitations in study instru- 
ments 3 through 11. Limitations were found in: 

• The structure of some questions — the consequence of which 
was that questions could be interpreted in several ways 
and, as a result, the data secured were inconsistent and 
non-comparable . 

• The length and specific content of some instrximents — 
the consequence of which was that teachers con^lained 
about the tlje required to complete questionnaires and 
did net always provide information which could be used 
in the final data analysis. 

In view of these limitations, GRC conducted a detailed review of 
all instruments and modified these instruments, where appropriate, to 
clarify ambiguous questions and to eliminate questions not directly 
related to the objectives of this study. 

Revised instruments were cleared through the Federal Education 
Dat: Acquisition Committee (FEDAC) in 1979 and used in the final round 
of data collection In the spring of 1979. 

DATA COLLECTION PROCEDURES 

Spring, summer, and fall data collection activities focused on 
different purposes and entailed slightly different procedures. The 
major purposes of the spring site visits were to: 

• Administer the data collection instruments to each of the 
nine respondent groups and to assist in the administration 
of the SDRT. 

• Conduct interviews with district administrators, principals, 
and project directors to gain additional anecdotal infor- 
mation. 
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Conduct observations of classroom teachers and reading 
specialists and/or reading teachers in Special Emphasis 
and comparison schools. 



The purpose of the sunmver site visits was to: 

• Identify the types of activities which were provided by 
these programs. 

• Document the manner in which teaching approaches, instruc- 
tional intensity, and staffing patterns resembled or differed 
from the regular school year Special Emphasis program. 

• Determine the ID numbers and attendance records of students 
who participated in the sumner program. Because attendance 
data had not been obtained during the 1977 summer program, 
GRC attempted also to obtain these data. 



The purpose of the fall site visits was to: 

• Assess comparability of the experimental and comparison 
schools, thereby assessing the integrity of the experimental 
design. The data gathered during this process represented 

a set of annual baseline data for each project. 

•» Collect information to determine whether the projects met 
the criteria that were established in the legislation and 
the regulations. 

• Supervise the administi ition of the SDRT. 

Data collection activities for the study were undertaken in fall 
1976 and spring, summer, and fall 1977 by the original study contractor 
and in spring, summer, and fall 1978 and 1979 by GRC. Table G.2, Data 
Collection Schedule, provides a summary of the utilization of the study 
instruments during the respective data collection periods. (Procedures 
employed in the 1976-77 school year and fall 1977 data collections 
conducted by the original study conr ; * - are described in the Fir^^t 
Annual Report.) 
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TABLE G.2 
DATA COLLECTION SCHEDULE 



Data Collection Points 



1977 

■S pring Smnmer Pall 



1978 

Spring Sunmer Fall 



1979 

Spring Summer Fall 



X 



X 

X 

X 

X 

X 

X 

X 

X 
X 
X 
X 



X 



X 

X 

X 

X 

X 

X 

X 

X 

X 

X 
X 
X 

X 



X 



X 

X 

X 

X 

X 

X 

X 

X 

X 

X 
X 
X 
X 



When GkC assumed responsibility for this study in April 1978, 
several changes were incorporated into the data collection activities: 

• Data on the demographic characteristics of students and 
specific treatments in reading instruction were collected 
for the first time. 

• .8 responsibility for the administration of the SDRT was 
shifted from the reading specialists to the individual 
classroom teacher. This change was motivated by a need 

to equalize the conditions of administration in both experi- 
mental and conq)arison schools and to comply with the admin- 
istration instructions of the SDRT manual, 

• The testing and questionnaire administrations were systema- 
tized by the use of briefing sessions with teachers followed 
by written instructions for teachers and project supervisors, 
(Instructions are contained in Volume II of this report,) 

• Special consideration was given to the concerns of comparison 
school staff regarding their participation in the study. 

In response to their concerns, GRC provided an update on 
the purpose and scope of the study, required that the com- 
parison, teachers test their own students under supervision 
of GRC and project reading specialists, and provided the 
teachers with printouts of test score results on the SDRT 
for their students. 



At the beginning of the 1978 and 1979 visits, GRC/Americas staff 
met with the entire staffs of the respective schools to introduce . the 
evaluation team, provide an updates on Lhe evaluation, listen to their 
concerns, and elicit their cooperation, Prj ot directors at each of 
the project sites were responsible for coordinating the data collection 
activities. 

Supervision of the Testing - Spring and Fall Data Collections 

To assure intersite consistency in the administration of the SDRT, 
GRC developed a set of instructions designed to overcome some of the 
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problems experienced by the previous contractor. The key features of 
these procedures were: 

• Supervision of the entire testing process in both the Special 
Emphasis and comparison schools by Special Emphasis reading 
specialists who also were available to provide assistance 
when necessiii. ^ . 

• Administration of the SDRT by the respective classrooE 
teachers of reading. Each teacher was instructed to adhere 
to the directives in the SDRT manual which he or she received 
in advance of the testing. 

• Careful coding of the test booklets to assure correct 
identification of each student while preserving the student's 
anonymity. 

• Onsite supervision of the testing by GRC/Americas staff who 
monitored the testing rooms without distracting the children 
being tested. 

• Notation of any special conditions with respect to individual 
students present during the testing. For example, instances 
of emotional upset, illness, or students making random 
markings were afterwards noted on the test booklets by the 
administering teacher. 

Collection of Program and Participant Data - Spring Data Collections 
The collection of program and participant data was designed to 
coincide with the spring administration of the SDRT. 

All staff questionnaires were filled out by the respondents after 
a group briefing by GRC/Americas staff. Directions for answering 
specific questions weie provx^ad on each instrument. Additionally, 
GRC/Americas staff assisted re^qpondents with clarifications when 
necessary, and personally collected completed instruments to assure 
confidentiality of responses. 



Instruments to which students responded were self-explanatory; 
however, in classes where students had reading problems, teachers read 
the questions to the class. 

Parent instruments were given to all students in grades 1 through 
6 to be delivered to parents and returned within a week* To assure an 
adequate response rate, follow-up procedures were undertaken by indi- 
vidual project directors in conformance with district policies. Distri- 
bution and collection of these instruments were the responsibility of 
the classroom teachers. 

All questionnaires were administered from mid-May througji early- 
June 1978 and 1979, with the exception of the site "close out" topic 
guide which was administered in fall 1979. 

The final round of site visits was made to each of the project 
sites to monitor the final round of testing and conduct "close out" 
interviews with a sample of teachers from the Special Emphasis schools, 
the principal, project director, and cognizant official from the school 
district. These interviews provided a retrospective assessment of the 
implementation of Special Emphasis as well as perceptions of the residual 
effects of the program after Federal funding ended. 

PROBLEMS IN DATA COLLECTIOl^I 

In spite of an attempt to carefiilly specify procedures for data 
collection, a number of problems arose at individual sites. A brief 
summary of these problems follows. 

General Problems 

The project sites in general experienced 10-30% student turnover 
during each year of the evaluation. A combination of student turnover 
and the coding problems effectively reduced the total number of pre- 
and posttest observations available for analysis. 
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The timing of the spring visits contributed to several overall 
problems , including : 

• Students were taking the SDRT and their school district's 
standardized tests back to back. Test fatigue was apparent 
for students, teachers, and administrators. 

• End of the school year activities (picnics, trips) were 
distracting to the testing process, inhibiting students' 
performance on the SDRT. 

• Teachers and administrators had pressing end-of-the-year 
paperwork demanding attention and were vexed over the 
additional work entailed by the testing. 

To minimize these problems and their effect on the study, GRC 
attempted to schedule its spring visits several weeks before the end 
of the school year and at times suggested by local principals and 
project staff. 



Problems of data collection encountered at the specific Special 
Emphasis sites are summarized below. 

Louisiana 

Coding problems on the SDRT caused delays in the data reduction 
process, and contributed to a loss in the number of observations when 
coding problems could not be resolved. For example, the ID codes 
assigned to grade 3 students in the comparison school during spring 
1977 were replaced by new ID codes in fall 1977, causing the loss of 
these observ':itions. Other instrtiments, namely those for students 
and parents, were returned to GRC with only the site and school identi- 
fying numbers affixed. Student questionnaires, grade 3, were not 
received for 1977-78 school year. 

Michigan ' 

Owing to scheduling conflicts and local staff preferences, some 
of the testing was held at a time when GRC staff was not present to 
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monitor. Further, reading specialists from the experimental school 
administered the reading tests in the comparison school in spring 1978, 
contrary to specific directions. GRC also noted that testing of younger 
children, in some instances, was conducted on a single day, contrary to 
directives in the SORT manual. Sixth grade students were not tested 
during spring and fall 1979 because they had been transferred to other 
schools. 

Ohio 

Because of a union dispute, the SORT was administered in the 
comparison school by the Special Emphasis project director and the 
district reading and language arts supervisor. In addition, GRC was 
unable to observe reading instruction in all classrooms. Because of 
the court-ordered dispersion of students in the fall of 1978, seventh 
grade students were not tested on the SORT. 

Tennessee 

No major data collfection problems occurred. 

Texas 

The administration of the testing in fall 1978 at the comparison 
school was not monitored by GRC/Americas . In addition, teacher adminis- 
trators of the test erroneously omitted tbi final subtests for first 
graders in spring 1978, in effect losing observations on first grader? 
for that data point. In addition, during the first year of the study, 
sosja students were assigned duplicate ID codes. 

West Virg inia 

Lack of communication between the project director and the 
comparison school, plus a growing reluctance on the part of the 
comparison school to participate in the Special Emphasis project, caused 
numerous problems at this site, student Information Checklists were 
not completed in the comparison school during the spring 1978 data 
collection. They were, however, completed the following fall. Student 
and parent questionnaires from the Special Emphasis school lacked 
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complete coding, limiting the analysis to aggregated data. Student and 
parent questionnaires were never administered in the comparison school 
in 1978. A number of student and teacher identification code problems 
were also experienced. During the final round of testing, seventh 
graders were not tested until 5 weeks after the other students. In 
addition, the Special Emphasis school principal ordered large-scale 
out-of-level testing of students, whereas few students in the comparison 
school were similarly "downshifted." 

California 

Some teachers in the comparison school exhibited an indifference 
toward the study to the extent of giving lackadaisical responses to 
questiormaire items. Coding on all parent questionnaires was incomplete. 
Attendance data for summer 1979 were not available. 

DATA PREPARATION AND REDUCTION 

The data prepare. tion and reduction process was an ongoing activity. 
Initially, all data tapes received from A^ were reviewed by GRC to 
determine content and quality of the data. From this initial assessment. 
GRC identified several problems with the coding of the SDRTs: 



In fall. 1976, only a portion of the fifth and sixth grade 
students were assigned unique 4-digit ID codes. Therefore, 
scores could only be identified by site, school, and grade, 
but not by individual student. 

In a number of cases, for spring and fall 1977, two and 
sometimes three students had been assigned the same 4-digit 
ID codes. 



As a result, GRC established a series of validation checks to 
assure the accuracy of the data for future data collections • The data 
previoiisly collected by AMS for fall 1976, spring 1977, and fall 1977 
was checked and, to the extent possible, corrections were made. GRC 
decided at this point, with the concurrence of the USOE project officer, 
to drop the fall 1976 data point from the analysis due to the inability 
to link a sufficient number of the test scores to individual students. 
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For all testing dates after fall 1977, all SDRT answer booklets 
were batched upon receipt at GRC into groups based on site, school, 
grade, and test level taken. Each booklet was checked for completeness 
and each 10-digit code was checked for omissions or errors. The SDRTs 
were then sent to The Psychological Corporation to be machine scored. 
Initially, raw scores, grade equivalents, and percentiles were received 
for each subtest taken. For spring 1979 and fall 1979, scaled scores 
were also received for each student. 

When the scored tape was returned to GRC, an edit was performed 
to determine whether the tape was complete and to establish a new 
student identification code which included the site, school, 4-digit 
ID code, student birth month, birth year, and sex. Additionally, 
duplicate records and records without adequate identification were 
eliminated, and range checks were performed on all data fields. For 
those tapes without scaled scores, a conversion was performed to trans- 
form raw scores to scaled scores while preserving the initial raw score. 

In addition, as each tape was processed, an index was created 
and updated to form a complete test history for each student. With 
each subsequent testing, each record was checked to determine consistency 
between testings of the bitthdate, sex, and grade level for each 
student. The extent of o-c-of-level testing was also determined. 

As this process continued, it became apparent that there were 
numerous errors either in the 4-digit ID code assigned or in the 
recording of birthdate and sex on the answer booklet. Therefore, during 
spring 1979, each project site was given a complete testing history for 
each student through fall 1978 and asked to verify the accuracy of the 
birthdate and sex associated with the 4-digit ID code. As a result, 
many errors were resolved preserving as much data as possible for the 
analysis. Table G.3, Statistics on Error Resolution, contains a complete 
summary of the magnitude of the error resolution process. 
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TABLE G,3 
STATISTICS ON ERROR RESOLUTION 



Nunii>er Vests Scored 

N limber Instruments Received 

RECORDS DELKTED DUE IX): 



I. 

2. 
3. 



rnruaipletc identification 
Incomplete tea ting 
Other (includes duplicate 
tcHtn. tefltfl from two sites 
not refunded in 1977) 



NET^RECIJRUS 

5??2R|>S KEQU iRfNG CORRECTION OF : 

!• fiirtlidnte only 

2. " Sex only 

3. Both birthdate and sex 
A. Special condition only 

5. Student identification only 

6. Site only 

7. Schnnl only 

8. At leaBt two of school* 
student Identification, 
hirthdate, and sex 

9. (trade only 

RECORJjS WITH QUT-OF-LEV EI. TESTING 

KEamhS (JRADE INCONSISTENT WITH 
PREVIOUS TESTINn (INCLUDES 
STUDENTS RETAINED IN GRADE) 



(spring 


faTx 


1 1977 


1977 



N/A 



SDR' 


L* TEST DATE 


SPRING * 


FAl.L 


SPRING r 


FALL 


1978 


1978 


1979 1 


1979 



327 



201 



6202 


7292 


5710 


5221 


A7A2 


46:j/ 


23 


23 


20 




2 


5 


133 


1081'*' 




59 


18 


23 


915 


800 


39 


5 


9 


63 


5131 


5388 


5316 


5153 


4713 


3999 


383 


3A1 


282 


AO 3 


240 


312 


101 


101 


77 


73 


43 


59 


28 


12 


12 


23 


11 


7 




80 


58 


32 


17 


8 


5 


2 


1 


2 


1 




12 


13 


5 


8 


8 


6 


7 


7 


3 


1 






16 


19 


59 


2 


11 








102 


132 


153 


129 



12 



206 



SPRING 
1978 



5819 

2 
40 

5777 



441 
97 
16 
34 
41 



3 

N/A 
N/A 



SICL* COL LEC r I ON 
SPRiNGl 

4637 

5 
25 

4607 



319 
198 
50 
48 
11 



3 

N/A 
N/A 



* 

Student Information ClieckUst 

Flrat graclefB at some sites were given a porllon of the SDRT. 

% 

First graders at one site were given a portion of the SORT. 

4 
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After the error resolution process was completed, the latest test 
scores were added to the data base compiled from the previous test 
scores. 

A similar procedure was employed to validate the data on the 
Student Information Checklist, and these data were also added to the 
data base. 

The final data base contains a record for each student who took 
any of the SDRTs between spring 1977 and fall 1979. Each record contains 
demographic data and reading intensity data from the Student Information 
Checklists. These records also contain the student's score for each 
subtest for each testing represented as: 

• Raw Score — The number of questions the student answered 
correctly. 

• Grade Eq uivalent — Represents the typical performance of 
pupils in a specified grade when tested in a given month 
of the school year. The grade equivalent scores can range 
from 1.0 to 12.9, but the range is smaller for the red and 
green level tests. 

• Scaled Scores — Express performance on a single scale which 
cuts across test times and test levels. The usefulness 

of a single score is that it permits comparisons of student's 
performance over time and aggregation of students who took 
different levels of the SDRT. It is the most appropriate 
form of the student's score to use in evaluating change 
in performance over time since scaled scores have equal 
intervals. 

The completed data base contains 9885 records. 

PRELIMINARY DATA EXAMINATION 

Following the correction of coding errors and creation of the 
complete data base, a preliminary examination of the data was performed 
to: 
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• Develop a complete SDRT test history for each site. 

• Determine whether differences existed betr^^een students for 
whom both pre- and posttest scores had been secured and 
students for whom only pre- or posttest scores had been 
secured. 

• Determine whether ceiling or floor^ effects were encountered 

The results of this preliminary examination provided data on attri 
tion in the study sample. These data, combined with test scores for all 
students, were used to examine the effect of attrition on the general- 
izability of evaluation results. The statistical meiihodology used in 
the analysis of the impact of Special Emphasis treatment on reading 
achievement was reexamined to determine its appropriateness in view 
of the limitations of the data* A detailed discussion of each step in 
the preliminary examination follows. 

SDRT Test History 

A SDRT Test History for each site is contained in Appendix A. 
An example of one SDRT Test History appears on Table G.4. This table 
provides a frequency count, by grade, school, and project year, of: 

• Students with SDRT scores for any of the test -points 
between the spring of the previous school year and the 
spring of the designated project Tear (line 1) . For example 
for project year 1977-78, the frequency count included any 
student with SDRT scores for one or more of the following 
data points: spring 1977, fall 1977, and spring 1978. 

• Students designated as having learning problems (line 2) . 

• Students with pretest SDRT scores only (line 3) . This line 
represents a count of students for whom SDRT scores were 
obtained in the spring of the previous school year and/or 
the fall of the designated project year, but for whom SDRT 
scores were not obtained in the spring of the designated 
project year. 

1 

These terms are identified in the Glossary. 
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TABLE GA 
SDRT TEST HISTORY 

Projec t Year 1977;:78 



Site: WEST VIRGINIA 



Grade : 


2 




4 


5 


6 


TOTAL 


School: 


Sp.Em. 


fnnin 




C(>inp « 


Op • tin. 


Cnmp, 


Sp.Em. 


Coiap. 


Sp.Em. 


Comp. 


Sp.Em. 


Coinp. 


I- Tutal No. Students took 
SDRT (spring, fall 1977; 
spring 1978) 


7n 
i\i 




68 




71 


65 


69 


72 


71 


74 


349 


350 


2. No. Designated as Having 
Learning rroblens 


5 


0 


7 


6 


8 


7 


0 


0 


0 


n 






}n No. took Sorln0/F.in 1Q77 
SDRTs only 


to 


7 


11 


12 


17 


15 


8 


18 


14 


13 


60 


65 


4. No. took Spring 1978 SDRT 
only 


10 


15 


6 


12 


. 8 


6 


9 


15 


12 


15 


45 


63 


S. No. In Sample Size for 
ANCOVA Analyses 
(l-(243+4)) 


«5 


52 


hi* 


35 


38 


37 


52 


39 


45 


46 


224 


209 



Pro.'e ct Yea r 1978-79 



Grade: 


2 


3 


k 


5 


6 


TOTATr"'"" 


School : 


Sp.Em. 


Comp. 


Sp.Em. 


Comp . 


Sp.Em. 


Comp. 


Sp.Em. 


Comp. 


Sp^Em.' 


Comp. 


Sp.Em. 


1 Comp. 


Total No. Students took 
SDRT (spring, fall 1978; 
Bprlng 1979) 


83 


79 


66 


69 


6S 


63 


73 


66 


77 


68 


368 


345 


No. Designated as Having 
learning Problems 


0 


0 


3 


0 


4 


0 


7 


0 


0 


0 


14 


0 j 


No, look Spring/Fall 1978 
SllRTs only 


4 


13 


4 


21 


10 


15 


8 


14 


9 


24 


35 


.. i 

87 


No. took Spring 1978 SDRT 
only 


11 


fl 


7 


8 


13 


8 


11 


14 


n 


9 


55 


47 


No. !n Sample Size for 
ANCOVA AnalySRS 
(I-(2I1I4)) 


68 


58 


52 


40 


42 


40 


47 




55 


35 


264 


211 



360 



• Students with posttest SDRT scores only (line 4) • 

• Students for whom both pre- and posttest scores were avail- 
able and who, therefore, comprised the analytic sample on 
which analyses were conducted (line 5) . Line 5 is computed 
by subtracting the total of lines 2, 3, and 4 from line 1, 

The difference between the total number of students with any 
SDRT scores for the designated project year (line 1 on Table G.4 and 
the number in the analytic sample (line 5 on Table G.4) provides a 
measure of sample attrition due to student turnover, absenteeism, 
errors in coding SDRT answer booklets and purposive exclusion (students 
with diagnosed learning disabilities) . 

These data from Appendix A and the calculated level of retention 
are summarized in the right-hand columns (4 and 5) of Table G.5, Sample 
Retention Summary. The potential number of students, taken from 
Appendix A, is the total number of students who took any of the SDRTs 
for the designated project year, aggregated over grades 2 through 6. 
The actual number of students, also taken from Appendix A, is the number 
of students, aggregated over grades 2 through 6, who were included in 
the "whole grade" analytic sample. These numbers match the numbers of 
students contained in the impacts summaries in Appendix E. The percent 
of retention , then, is the actual number of students divided by the 
potential number of students. As noted in Table G.5, between 46% and 
86% of the potential number of students are actually included in the 
1977-78 "whole grade" analytic samples. Therefore, the level of attri- 
tion was between 14% and 54%. For 1978-79, the retention rate ranged 
from 32% to 72%, indicating attrition levels between 28% and 68%.. This 
level of attrition can be partially attributed to mobility and absenteeism, 
but the high level of attrition for some sites would indicate other 
problems also. 

A measure of mobility between school years for each site is also 
contained on Table G.5. This would not include students who moved during 
the 1978-79 school year. For example, for the Texas Special Emphasis 
school, 17% of the students were tested only during the 1977-78 project 



Xm G.5 
SAMPLE REIENTION SUMMARY 



Site 



School 



(1) 

Net Student 
SaBple* 



I.A S|H>cl.il Ruiphasls 410 
Comparison 957^ 



(2) 

Tested 
7?-78 Only 
N I of Net^ 



53 
215 



131 

m 



55 

111 



(3) 

Tested 
78-79 fliily 

m 

12Z 



(*) 

Analytic Sample 
77-78 (gr. 2-6) 
Potential Actual I 



313 

721' 



174 
395 



5« 



(5) 

Analytic Sanple 
7H-79 (gc. 2-6) 



X I'ptMial Acjjial l_ 



m 
m 



170 
365 



521 



HI Special Ri 
CnmparLion 



943 
826 



175 
162 



19t 
20Z 



130 
112 



14! 
142 



693 
615 



385 
30? 



56Z 

m 



578 
485 



338 
266 



581 
55Z 



Special Ei«pli8Bl9 
Comparison 



322 



N/A 

N/A 



N/A 



N/A 
N/A 



N/A 
N/A 



317 
275 



175 
142 



551 

523; 



N/A 
N/A 



N/A 
N/A 



N/A 
N/A 



IN Special Kmpliasls 413 
Cnmiiarlson 276 



47 
40 



m 

14Z 



46 
29 



IIZ 
lU 



320 
207 



197 

96 



622 
462 



308 
159 



204 



662 
632 



TX Special Emphasis 779^ 131 m 241 

ConiiarlRon 952 155 162 102 



312 
322 



53811 
649' 



278 
134 



522 
512 



428** 
510** 



193 
249 



452 
482 



WV Special Emphasis 483 
Cnnparliion 468 



46 
53 



102 
112 



62 
59 



132 
132 



349 
350 



224 
209 



mi 
602 



345 



264 
211 



722 
612 



CA Special Emphasis 309 
CtHnparison 458 



14 
44 



52 
102 



lOl 
147 



332 
322 



172 
279 



148 
187 



862 
672 



264 
359 



118 
116 



452 
322 



Diit's not Include students graduating spring 1977 or first graders 
In spring 1979. 

t 

noes not Include stuileiits graduating spring 1977, 
"l)">es not indude first graders in spring 1979. 



5.. 



Adjusted to coiopensate for codtnq errors. 



Does not Include grade 2 for whicli no analysis could be done. 




year (column 2) and 31% were tested only during the 1978-79 project year 
(column 3). Therefore, 48% of the net student sample, did not participate 
in the evaluation for the full length of the project. The net student 
sample (column 1) is the total number of students tested at each site 
over the full course of the study, with the exception of students 
graduating from the program in spring 1977 and first graders in spring 
1979. 

Differences Between "Pre- and Posttest" Groups and "Pre" or "Posttest 
Only" Groups 

Students included in the analytic samples are those with both 
pretest SDRT scores and posttest SDRT scores. Students excluded from 
the sample, but for whom partial information is available, are those 
with either a pretest SDRT score or a posttest SDRT score only . (No 
data are available for students who were in the school during the 
designated project year but who took none of the SDKTs.) 

Summaries of the differences in "comprehension total""^ scores 
between students included in the analytic samples and those excluded 
from the sample are contained in tables for each site in Appendix B. 
An example of one table from this series is presented in Table G.6. 

Table G.6 identifies differences — by project year, school, aid 
grade — in test scores for "pretest only" students and "posttest only" 
students as contrasted with the "pre- and posttest" students. For 
each "pre- and posttest" group, an interval was calculated with limits 
of _f one-third of a standard deviation from the mean "comprehension 
total" scaled score of that group. This interval was then used as the 
reference for determining whether the "pretest only" or "posttest only" 
groups differed substantially from the "pre- and posttest" group, i.e., 
the group used in the analysis of impact. One-third of a standard 



Comprehension total is a composite score derived from scores on two 
subtests of the SDRT. 
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TABLE G.6 

SIMIARY OF DIFTSSENCZS BETWE2N STTJDEOTS WITH BOTH 
pas- AND POSTTSST SCORES AND STUDENTS WITH 
PBETSST OR POSTTEST ONLY 



Project Year: 1977-1978 



SCHOOL 




GRADE (Spring 1978) 
2 3 4 5 6 


Special Emphasis 
Comparison 


Pretest Only 
Posttest Only 

Pretest Only 
Posttest Only 


0 - + 0 - 

+ + 0 + 0 

0 0 - ^0 0 
+ 0 + - + 


Project Year: 1978-1979 


SCHOOL 




GRADE (Spring 1979) 
2 3 4 5 6 


Special Eopahsls 
Comparison 


Pretest Only 
Posttest Only 

Pretest Only 
Pcattest Only 


-00+0 
0 + 0 + + 

0 + 0 - 0 
- + + - 0 



KEY: 

O: Differerica becveen mean scaled score of pre- or posttest only group is less 
ciiaa 1/3 .si:.andard deviation from mean of pra- and posttest group. 

Mean scaled score of pre- or posttest only group is aore than 1/3 standard 
deviation higher than mean of pre- and posttest group. 

Mean scaled score of pre- or posttest only group is sore than 1/3 standard 
deviation lower than mean of pre- and posttest group. 
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deviation has been suggested as a useful rule of thumb for consideration 
of treatment effects as educationally significant.^ 

If the "pretest only" or "posttest only" group's mean "compre- 
hension total" scaled score fell within the calculated interval, there 
were assumed to be no substantial differences between that group and 
the "pre- and posttest" group. On the other hand, if the mean "com- 
prehension total" scaled score for the "pretest only" or "posttest only" 
group fell outside the calculated interval, it was assumed that major 
differences did exist between that group and the "pre- and posttest" 
group.- The existence of systematic differences would indicate that 
the evaluation results based on students' with both pre- and posttest 
scores may rot be representative of all the programme particJLpants and 
that the conclusions could not be generalized for all participants. 

For example, in Table G.6, for grade 2 in project year 1977-78 
and "pretest only" groups for both the Special Emphasis and comparison 
schools are designated by "0," indicating that students who took the 
pretest did not differ substantially from their respective "pre- and posttest 
groups. On the other hand, a "+" for the "posttest only" groups for 
both schools indicates that the groups for students who took the posttest, 
but not the pretest, scored higher than the groups on which the analysis 
was performed. For this case, the direction is the same for both the 
treatment and coB^arison schools, thus, the posttest scores used in the 
analyses of impact might be an underestimate for both schools. A "-" 
for the "pretest only" group for project year 1977-78, grade 3, Special 
Emphasis school, indicates that the students who took the pretest, but 
not the posttest, scored lower than the group on which the analysis was 
performed. 

There are many possible reasons why the "pretest only" or 
"posttest only" groups differed from the "pre- and posttest" group, 

^D. P. Horst, G. K. Tallmadge, and C. T. Wood, A Practical Guide to 
Measuring Project Imi»act on Student Achievemen t. (Washington, D.C., 
US Government Printing Office, 1976) (Stock No. 017-080-01460), p. 69. 



G-22 

^6g 



e.g., testing ..rin^ times of the year when certain groups of students 
are absent. An investigation to determine these reasons for each 
instance of difference is beyond the scope of this study, but the 
existence of differences has been examined to determine the representa- 
tiveness of the analytic samples. 

Floor and Ceiling Effects 

If the SDRT administered to lower achieving students in each 
analytic sample was too difficult, these students would only be able 
to answer a few questions correctly. When this occurs, students are 
saia to have encountered the test floor. The effect of an apparent 
test floor is that the student's score would be an overestimate of 
his/her true score. 

If the test was too easy for higher achieving students, these 
students would be able to answer all or almost all questions correctly, 
the test ceiling would be encountered. The resulting scores would 
underestimate the students' true scores. 

The presence of floor effects on a pretest or ceiling effects 
on a posttest would indicate that the observed gain is an underestimate 
of the true gain. On the other hand, the presence of ceiling effects 
on a pretest or floor effects on a posttest would indicate that the 
observed gain is an overestimate of the true gain. Where floor or 
ceiling effects are encountered for both the pretest and the posttest, 
either an underestimate or an overestimate of true gain can result. 

An examination of the SDRT mean "con5)rehension total" raw score 
for each class unit for each test date was performed to determine 
whether floor and/or ceiling effects were encountered and, if so, the 
implications for the analysis of impact. While the test floor or 
ceiling may have been encountered for individual students within all 
classes, the effect of the floor and/or ceiling effect vis-a-vis 
individual students was not considered s-arious — e.g., was assumed to 
have no significant effect on the outcome of the analysis — unless the 
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class mean "comprehension total" raw score was below 30% correct or above 
70% correct for the test floor or ceiling, respectively. The criterion 
of 30% correct to indicate serious floor effects was chosen because the 
two reading comprehension subtests on the SDRT are either three-choice 
or four-choice multiple questions and, on a pure chance basis, a 
student would score between 25% and 33% correct. Therefore, a mean 
class score of 30% correct would indicate that a Substantial number of 
students in the class scored at or below the chance level. On the other 
hand, a mean class score above 70%''" correct would indicate that a 
substantial number of students answered all, or almost all, the questions 
correctly. 

Appendix C contains summaries of the class-by-class mean "com- 
prehension total" raw scores for each site and school for each test 
date. A'C or 'F' opposite the class scores on these tables, indicates 
whether ceiling or floor effects were encounceied. Table G.7 provides 
an example of one such summary. For each test point and grade, the 
table provides the mean "comprehension total" raw score for each class 
unit. For example, for spring 1978, grade 3, there are four class 
units wr.th mean raw scores of 51.6, 39.5. 41.6, and 47.0. A student's 
raw score was included in the computation of the class mean raw score 
if the student (1) was not designated as having a learning problem 
and (2) took the appropriate test level for his/her grade. For the 
cited example, two of tha four classes encountered serious ceiling 
effects as indicated by the 'C' following the mean raw score. 

Examination of the l:ables in Appendix C shows that serious ceiling 
effects were encountered at all project sites. While there are occur- 
rences of ceiling effects for all grades and test dates, there is a 
greater frequency for grades 2 and 4 for each spring testing date. 
For spring 1977, in the aggregate, 89% of the second j^rade classes 
and 86% of the fourth grade classes encountered serious ceiling effects; 
for spring 19 7S, 90% and 86%, respectively, and for spring 1979, 95% 
and 89%, respectively, encountered serious ceiling effects. 

'''This figure was suggested by Dr. Bjorn Karlsen, an author of the SDRT.' 
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TABLE G.7 



MEAN RAW SCORES ON THE SDRT REPORTED BY CLASS 



!>lce:TKXAS 



School: SPECIAL EMPHASIS 



GRADE 
1 



.SgRIN G 1977 
H Jtaan Ind 



25 

22 
25 
21 
20 



29 
26 
26 
25 



A9.3 

52.2 
48.3 
54.1 
56.7 



23 78.6 C 

24 80.9 C 
24 79.7 C 
24 75.5 C 



26 


44.2 


C 


28 


49.3 


C 


27 


47.1 


C 



Jl.9 
34.7 
37.9 
27.0 



Test Level 

Green 
Brown 



_JALL 1977_ 
N Mean Ind 



21 
22 
23 
23 
214 



51.1 
58.1 
54.3 
54.0 

65.0 C 



28 


54.3 


C 


22 


48.1 


25 


51.8 


C 


22 


51.4 


24 


48.8 


C 


23 


46.8 








22 


44.2 



24 
24 
23 
22 



45.7 
33.3 
32.1 
38.6 



52 28.6 

52 30.3 

46 30.8 

25 27.2 



SDRT_1'EST POINTS " 
N Menn Iiid 



C 
C 
C 
C 



21 77.9 
23 83.1 

22 78.0 

23 77.2 
23 82.2 



C 
C 
C 
C 
C 



24 
25 
23 
18 



51.6 
39.5 
41.6 
47.0 



21 50.6 

22 53.9 

23 48.3 
19 51.2 



C 

C 

r 

C 



29 36.8 
26 36.3 
26 35.5 



Hajciimim Score 
90 ~ 
60 
60 



- . ■ f-A' l'978 
. N Mean Ind 


" SPRfNG 1979 
N Mean Ind 

26 62.6 
24 59.4 
21 73.1 G 
19 65.3 C 


'fall 1^79""" 


21 63.7 C 
21 59.8 
20 63.1 C 
17 55.0 
19 56.2 


18 82.2 C 

19 84.5 C 

20 81.9 C 

18 84.4 C 

19 78.9 C 


18 68.2 C 
18 70 7 r 
18 71.7 C 
16 69.9 C 


25 37.3 
29 37.5 
27 38.7 
25 34.2 


25 49.5 C 
31 47.3 C 
25 46.7 C 
28 41.6 


18 IS S 

18 43.7 G 

19 38.4 
14 39.8 
18 36.2 


21 49.2 C 

16 46.6 C 
26 52.9 C 

17 42.2 C 


20 50.6 C 
17 51.2 C 
27 52.8 G 
14 51.6 G 


23 48.8 G 
27 45.5 G 
25 45.0 G 
23 43.6 G 


13 25.4 
22 24.2 
39 36.0 
6 24.2 


14 27.7 
27 36.2 
26 50.0 C 
20 28.9 


16 30.4 
15 28.7 
18 35.9 
13 26.3 


26 36.0 
24 32.9 
18 30.2 




15 27.5 
17 38.2 
22 48.9 G 
19 29.5 



Floo r (F) Effect Belou 
27~ 
18 
18 



CeUing (C) Effect AJjpve 
63 " 
42 
42 
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One reason for the preponderance of ceiling effects for grades 
2 and 4 appears to be that the SDRT was intentionally designed to be 
easy so that even low achieving students could experience some success. 
The result of this is that the distribution of test scores is negatively 
skewed rather than a normal distribution. The implications for the 
analysis of the impact of the Special Emphasis Project differs for 
each site, school, and grade dependent upon whether the ceiling was 
encountered on the pretest, the posttest, or both. 

DATA ANALYSIS PROCEDURES AND ISSUES 

The data analysis performed by GRC can be divided into two major 
categories; 

• A process analysis 

• An impact analysis 

The major features of the process analysis and the methodological issues 
and analysis of impact are discussed in the following topics. 

Process Analysis 

The process analysis component of this study sought to: 

• Provide a description of the Special Emphasis Project 
programs. ^ 

• Examine the degree to which each Special Emphasis project 
was in compliance with USOE staff and programmatic guide- 
lines . 

• Examine the comparability of Special Emphasis and compari- 
son schools with respect to student characteristics, school 
size, school staffing patterns and ctaff qualifications, 
and other features thought to be potentially confounding 
variables . 

• Examine the potential effect on the impact analysis of 
the Special Emphasis treatment of any noncomparability of 
the treatment and comparison schools. 



B. Karlsen, et al, p. 5. 



• Examine differences among Special Emphasis projects with ' 
respect to the delivery of the Special Emphasis treatment. 

The process analysis of the Special Emphasis Project was based on 
data and information collected from classroom observations, questionnaires, 
and interviews. Data and information used in the Special Emphasis Project 
process analysis included both institutional programmatic data and data 
on student and staff characteristics. These data included information 
on the following factors: 

Institutional/Programmatic Data 

• School facilities. 

• Qualifications and role functions of all Special Emphasis 
staff. 

• Instructional services provided by the Special Emphasis 
program. 

• Instructional materials used in the delivery of the Special 
Emphasis treatment. 

• The inservice training program. 

• Special features or circumstances. 

Student/Staff Characteristics Data 

• Student enrollment 

• Racial/ethnic mix of student body 

• Sex of students 

• Percent of students receiving free or reduced-price lunch 

• Percent of students for whom English is a second language 

• Percent of students absent more than 25% of time 

• Number of teachers 

• Percent of teachers with graduate degrees 

• Average teacher experience 

• Average number of students/ class 
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These data and information are reported on a site-by-site basis 
and examined across sites in Section 4, 

Impact - Methodological Issues 

As noted in Section 3, Evaluation Design and Methodology, there 
were several issues that were raised and investigated during the course 
of the study which affected the analysis plan. These issues can be 
divided into four categories: 

• The selection of a comparison group of students to compare 
with students receiving the Special Emphasis treatment. 

• The selection of an appropriate measure of reading 
achievement. 

• The use of posttest or gain score comparisons. 

• The period of time over which to analyze the impact of 
Special Etjophasis on reading achievement. 

A discussion follows for each of these categories on the issues 
raised and the rationale for the decisions made. 

Selection of a Comparison Group of Students 

The selection of appropriate groups to compare with the Special 
Emphasis students was required for both the school year program and the 
summer program. For the school year analysis, the selection of a 
comparison group for grades 1 and 2 posed no problem because all 
students in the Special Emphasis schools, except as noted in Section 5, 
participated in the Special Emphasis treatment. For the third through 
sixth grades, not all students in the Special Emphasis schools received 
the Special Emphasis "treatment." Therefore, procedures were investigated 
for grouping students on the basis of data being collected. 

For the first annual report. Applied Management Sciences, Inc., 
used a procedure whereby the experimental group included only those 
students who were reading "one grade equivalent below average."*'" The 



S. Frankel, et al, p. 2.16. 
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comparison group included only those students in the comparison school 
who were below the highest pretest raw scores for the experimental 
group. Methodologically, this procedure presents two problems: 

• Since students were not selected for Special Emphasis 
participation on the basis of the SORT, the basis for 
inclusion in the analytic sample, the experimental group 
would not necessarily encompass all students who participated 
and might include some who did not participate. 

• Since the comparison group was selected on the basis of 
a cutoff score derived from the experimental group, the 
comparison group would not necessarily represent the same 
proportion of students as the experimental group. This 
would lead to differential regression effects."^ 

Another method of grouping considered, and employed by GRC, was 
by grade, the implication being that the Special Emphasis Program 
encompassed the entire school population in grades 1 through 6 at the 
Special Emphasis school. While some students were receiving the Special 
Emphasis "treatment," the remaining students were involved in other 
activities, so there was an effect on the total population. While this 
is not an altogether satisfactory approach, it offers a starting point 
for consideration of impact and for sites with small enrollments pro- 
vided sufficient students (more than 30) so that the sample mean 
represents an efficient estimate of the population mean. 

Grouping students by class was also considered. Within the 
treatment school, this would pennit comparisons among classes with 
respect to variations in instructional approach or classroom management 
style. This grouping would not permit direct comparisons with the 



D.T. Campbell and A» Erlebacher, How Regression Artifacts in Quasi- 
experimental Evaluations Can Mistakenly Make Compensatory Education 
Look Harmful. In J» Hellmuth (Ed.), Compensatory Education; A 
Nation v\ l Debate . Vol. 3: Disadvantaged Child. New York: Brunner/Mazel, 
1970, p. 195-196. 
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classes in the comparisons school since no mechanisms were available 



tation showed that within each grade, there was virtually no variation 
in the approach or the management style as reported by teachers on 
the Classification of Teaching Practices instrument. 

Grouping by class would have permitted the comparison of class 
performance with national norms established for the SDRT. The Special 
Emphasis classes could then be compared to the comparison classes 
based on changes in performance in terms of normal curve equivalents 
(NCE) . Percentile-to-NCE conversion tables were developed for the 
Title I evaluation and reporting system. Either the class mean raw 
score or the class mean scaled score for comprehension total on the 
SDRT could be converted to the corresponding percentile and then to 
the NCE- 

Finally, groups could be developed to include an approximation 

of only those students for whom Special Emphasis was intended. The 

groups would consist of only those students scoring below the mean 

score for their grade in each school. Where the mean and median scores 

are close, approximately equal proportions of students would be included 

in the analytic samples for each school. This technique mitigates 

the problem of differential regression effects previously mentioned. 

The problem of inclusion of students who did not receive the Special 

Emphasis "teatment" remains, in addition to the problem of small 

sample sizes (less than 30). "in general, the smaller the sample, 

the more likely that the mean of the sample will be a less efficient 

2 

estimation of the population mean." 



"The NCE "is an equal-interval, normalized, standard score with a mean 
of 50 and a standard deviation of 21.06. It has a range from 1 to 
99 and matches the percentile rank at values 1, 50, and 99." B. M. 
Fagan and D. P. Horst, Types of Test Scores , Technical Paper No. 8, 
Mountain, View, CA, KMC Research Corporation, 1976, pp. 6-7. 

D. J. Pal umbo. Statistics in Political and Behavioral Sciences , New 
York: Columbia University Press, 1977, p. 280. 



for matching classes. In addition, an examination of teaching orien- 
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The decision was made to perform the analysis of impact on reading 
achievement for both whole grade cohort groups, all the students within 
each grade for whom both the pretest and posttest scores were available, 
and for the groups of students with scores below their respective grade 
means. The analysis of impact for class groupings was not done because 
the ceiling effects which were encountered would have biased the conver- 
sion to class percentiles and lead to a distorted estimate of the change 
in class performance. 

The measurement of program impact for the summer Special Emphasis 
Program presented a problem similar to that encountered in the comparison 
of classes. Because the program was voluntary, there were no mechanisms 
to match students in the corresponding comparison school to the students 
who participated in the suumer program. The alternative was to compare 
the participant's performance with national norms established for spring 
and fall testings of the SDRT. However, the ceiling effects encountered 
for the spring testing prevents this analysis from producing valid and 
reliable results. 



Selection o f Subtest Scores on Which to Base the Measurement 
of Reading Achievement 

The criterion for the selection of subtests on which to base the 
measurement of reading achievement were: 

• Commonality among all test levels. 

• A measure of achievement rather than diagnosis of skill 
deficiencies. 



The measure selected to assess achievement was the "comprehension 
total" score on. the SDRT. The "comprehension total" score is a composite 
score which is the'" total of the two comprehension subtest scores for 
each level of the SDRT. For the red level, recommended for grades 1 
and 2, the subtests that comprise "comprehension total" are "word reading" 
and "reading comprehension." For the green level, recommended for grades 
3 and 4, and the brown level, recommended for grades 5 through 8, the 
subtests are "literal comprehension" and "inferential comprehension." 
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The "comprehension total" score was recorded in the data base as 
a raw score, grade equivalent, and scaled score. The raw score was 
used in the assessment of ceiling or floor effects since it was neces- 
sary to know the number of questions answered correctly. The corre- 
sponding grade equivalent was used in the trend analysis of students 
reading 1 or more years below grade level. Scaled scores were used for 
all statistical analyses, i.e., analysis of covariance (ANCOVA) , since 
it is an equal interval scale permitting comparisons at different 
points on the scale and it was interlocked across test levels, mitigating 
the problem of ceiling effects encountered with the use of raw scores 
or grade equivalents. 

Use of Posttest or Gain Score Comparisons 

Once the criterion measure of reading achievement had been selected, 

a decision was required on the appropriate type of comparison to be 

made to determine the impact of the Special Emphasis Program. The 

objective was to determine whether the gain in reading achievement 

of the Special Emphasis treatment group was different from what would 

be expected of the same group of students without the treatment, where 

the expected gain is gauged by the performance of the comparison group. 

Both raw and residual gain score comparisons have often been utilized 

in educational research to meet this type of objective. Because of 

the presence of errors of measurement in the raw score (indicated when 

the test-retest reliability is less than 1), a comparison of either the 

mean raw or residual gain, as measured by either raw or scaled scores, 

between the Special Emphasis and comparison groups could give a dis- 

2 

tor ted view of true condition. In addition, because of the presence 
of serious ceiling effects for many of the classes , the use of any type 
of gain score would have biased the results in favor of the initially 
low scoring group. 



Residual gain scores are the difference between the observed posttest 
scores and the pretest scores predicted from the regression of posttest 
on pretest scores for the combined treatment and comparison groups. 

F. M. Lord, p. 21-38. 
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For the quasi-experimental treatment-comparison group design, 
the mechanism used considered the comparison group mean posttest score 
as to the no-treatment expectation with the pretest scores used to make 
compensating adjustments to the posttest scores for any initial differ- 
ences between the treatment and comparison groups. 

The two statistical techniques examined were: 

• Covariance analysis 

• Generalized multiple regression analysis 

ANCOVA is appropriate where the two pre-existing groups are 
enough alike to be considered random samples from a single population. 
Generalized regression analysis is appropriate where small systematic 
differences exist between the treatment and comparison groups or the 
groups should be considered as random samples from different populations. 
However, in cases where the treatment and comparison groups are signifi- 
cantly different, it is not generally possible to assess the impact of 
an educational intervention,^ even with the use of generalized multiple 
regression analyses. 

A preliminary analysis of the data revealed that no systematic 
differences existed between the treatment and comparison groups in 
terms of pretest scores. It was also determined through factor analytic 
techniques that the preteat score accounted for the majority of the 
variance in the posttest score. The other variables considered as 
covariates were students' sex, racial/ethnic background, SES, parent 
education, and primary language. A preliminary investigation of . 
intensity of Instruction showed that within site and grade, there was 
virtually no variation in the intensity of instruction as reported by 
the classroom teachers. 



"C. K, Tallmadge, and D. P. Hout, A Procedural Guide for Validating; 
Achievement Gains In Educational Projects . Washington, D.C., US 
Government Printing Office, 1976 (Stock No. 017-080-01460), p. 60. 




The analytic technique employed in the analysis of the impact 
of the Special Emphasis Program on students' reading achievement was 
ANOOVA with the posttest score as the crl cerion (dependent) variable, 
the treatment (either Special Emphasis or comparison) as the independent 
variable, and the pretest score as the covariate. 

Period of Time on Which to Base the Analysis of Impact of Special 
Emphasis on Reading Achievement 

Once it was determined that ANCOVA using posttest scores, adjusted 
for pretest differences, would be used to analyze the impact on reading 
achievement, it was necessary to determine the periods of time on 
which to assess impact. Because of the lack of comparison groups for 
the summer program, ANCOVA could not be used to analyze impact. For 
the school year program, however, data was available to analyze impact 
for project year 1977-78, project 1978-79, and the length of the study, 
1977-1979. The posttest score used for each of these periods was the 
final spring "comprehension total" scaled score for the period under 
study, i.e., the spring 1978 score served as the posttest score for 
the 1977-78 analyses, the spring 1979 score, served as the posttest 
for the 1978-79 and 1977- 79-'' analyses. 

Two options were available for the pretest score to be used: 

• The appropriate previous spring score. I.e., spring 1977 
for the 1977-78 analyses and the 1977-79 analysis, spring 
1978 for the 1978-79 analyses. 

• Tlie appropriate previous fall score, i.e., fall 1977 for 
the 1977-78 analyses and the 1977-79 analysis, fall 1978 
for the 1978-79 analyses. 

A decision was made to use the appropriate previous spring score, 
when possible, as the covariate. The appropriate previous fall score 
was used when the spring score was not available. Each of these cases 

^The "below mean" analyses were not done for 1977-79 because the sample 
sizes were too small to provide useful results. 
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is noted on the applicable tables. The spring score was chosen as 
the covariate because, in general, it was more highly correlated with 
the post test score and, therefore, provided a greater adjustment for 
initial differences. In addition, since the pretest was admir*istered 
at the same time of year as the posttest, the difference between the 
mean pretest and mean posttest provided a better measure of growth 
than changes from fall to spring. 

Impact Analysis 

The primary purposes of the evaluation of the Special Emphasis 
Project were to: . 

• Determine the impact on reading performance of students 
in the Special Emphasis and comparison schools during 
each school year and over the length of the study. 

• Determine differences in the retention of reading skills 
between schools with and without summer reading programs. 

« Determine the impact of the Special Emphasis Program on 
reading-related attitudes and behaviors of school staff, 
students, and parents. 

« Document the residual effects of the Special Emphasis 
Project within each participating school district and 
on project participants. 

Selected students in the Special Emphasis school were to receive 
the Special Emphasis treatment; students in the comparison school, who 
were, at the beginning of the project, presumed to be similar to the 
students in the Special Emphasis school, did not receive the Special 
Emphasis treatment. The treatment was actually two distinct treatments 

• The school year program in which all students, grades 1 and 
2 participated and students, grades 3 through 6 partici- 

, pated if selected by the school staff, the selection 
criteria being based on policy established at each site. 
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The summer program in which students volunteered to 
participate. 



the concurrence of USOE, the project team decided to: 

Consider each project site as a separate evaluation. 

Examine reading performance for each grade separately. 

Delete from the evaluation the investigation of summer 
program impact. A discussion of the issues related to this 
decision is presented in Section 3, Evaluation Design and 
Methodo logy. 

The analyses performed in this study were conducted through: 

• Covariance analyses of whole grade cohort groups for 
project years 1977-78 and 1978-79 and for the study period 
1977-79. 

• Covariance analyses of below mean cohort groups for project 
years 1977-78 and 1978-79. 

• Trend analysis of students reading 1 or more years below 
grade level for the study period 1977-79. 



With 



Covariance Analyses of Whole Grade Cohort Groups 

ANCOVA was used to compare students in each grade in each Special 
Emphasis school with their cohort group in the comparison school. Whole 
grade cohort groups consisted of all students within each grade, at 
each school, for whom both pre- and posttest scores were available. 
The use of ANCOVA permits the analysis of "the performance of several 
groups which are unequal with regard to an important variable as though 
they were equal in this respect. For this study, ANCOVA permitted 
comparison of Special Emphasis and comparison groups with pre-existing 

H?. J. Popham and K. A. Sifotnik, Educational Statistics: Use and 
Interpretation . New York, Harper & Row, Publishers, 1973, p. 205. 
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differences in pretest scores as though they were equal. The posttest 
"comprehension total" scaled score was used as the dependent variable 
in the statistical procedure. For project year 1977-78, the spring 
1978 score represented the posttest. For project year 1978-79 and for 
the 1977-79 analyses, the spring 1979 score represented the posttest. 
The posttest score was statistically adjusted for any initial differences 
that existed in the Special Emphasis and comparison cohorts in terms of 
the pretest "comprehension total" scaled score, called the covariate. 
For the 1977-78 and the 1977-79 analysis, the covariate was the spring 
1977 score. For the 1978-79 analysis, the spring 1978 score was used 
as the covariate. In a few cases when the spring 1977 or spring 1978 
score was not available, e.g., for California for the 1977-78 analysis, 
the preceding fall score was substituted as the covariate. These 
instances are all noted where applicable. 

Appendix E contains summaries of the covariance analyses for each 
site for each of the specified periods. One example follows on Table 
G.8. The table identifies: 

• The number of students in each of the analytic samples. 

• The mean pretest "coiiq)rehension total" scaled score for 
students in each analytic sample— i.e., the covariate. 

• The unadjusted posttest "comprehension total" scaled score 
for students in each analytic sample. 

• The adjusted mean posttest "comprehension total" scaled 
score. 

• The F value resulting from the calculation of the ANCOVA. 

• The level of significance of the F value which is dependent 
on the number of degrees of freedom. For this study, a 
value of .05 or less indicates that the difference in 
adjusted posttest achievement between the Special Emphasis 
and comparison cohorts is statistically significant. 
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TABLE G.8 



IMPACT SUMMARY FOR PROJECT YEAR 1978-79 
WHOLE GRADE 



DEPENDESn VARIABLE: SDSI Comprehensioa Total Posccast 

Scaled Score 

Un}E?ENDE2iT VARIABLE: Traataeat 

COVARIAIEi SDRT Comprehension Total Pretest 

Scaled Score 



Site: LOUISIANA 



ANCOVA 


Grade 


Treataent 


No. of Scudenta 


Mean Pretest 
Scaled Score 


ca 91 

9i 1-4 

X a 
u 

•O CO 
91 

u u 
o (a 
3 V 
•r-i u 91 
U • 

a ca 0 
sou 
::3 su V3 


•a 

91 

e i-i 

<S C3 
9i U 

X «a 
u 

iJ 91 

a u 0) 

z l-i 'M 

— a o 

■3 0 O 

•< W 


4) 

> 


Significance 
of F 


2 


Special Zstohasis 
Comparison 


27 
90 


258 
311 


346 C 
364 C 


372 
357 


4.19 


0.04 


3 


Special Emohasis 
Comparison 


34 
64 


343 C 
370 C 


421 
448 C 


437 
440 


0.09 


0.76 


4 


Special Eophasis 
Comparison 


30 
70 


428 
446 C 


465 C 
481 C 


477 
475 


0.00 


0.93 


5 


Special Emphasis 
Comparison 


33 
70 


457 C 
461 C 


490 
464 


494 
464 


6.78 


0.01 


6 


Special Emphasis 
Comparison ' 


46 
71 


495 
478 


540 
507 


529 
514 


1.97 


0.15 



Grade Equivalent 
of Mean Preteat 


Grade Equivalent 
of Mean Poatteat 


oj 

U 
ZD 

c c 

V ^ 
-3 > 


1*5 


2.4 


-h .9 


2.0 


2.6 


+ .6 


2.4 


.3-3 


-i- .9 


2.6 


3.8 


+1.2 


3.4 


4.3 


+ .9 


3.8 


4.7 


a. ^ '. 


4.1 


5.0 


+ .9 


4.2 


4.3 


+ .1 

i 


5.1 


6.6 


1 

+1.5 


4.6 


5.5 


+ .9 



C indicates that corresponding aean raw score above 70" correct (ceiling) . 
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The 'C' following the mean pretest or posttest scores indicates 
that there was evidence of serious ceiling effects derived from the 
corresponding mean raw score for the designated analytic sample. 



Table G.8 also siimmarizes reading performance in terms of grade 
equivalents for each analytic sanq)le. The mean pretest and unadjusted 
posttest scaled scores were converted to appropriate grade equivalents 
and the mean observed change was calculated. While this analysis can 
result in a built-in bias in favor of the initially low-scoring group, 
it is presented as an extension of the covariance analyses to provide 
a yardstick to measure growth against expectations with respect to 
national noriiw. Where the results of the ANCOVA are statistically 
significant, e.g., for grade 5 on Table G.8, the grade equivalent 
analysis provides a measure of educational significance. For grade 5,' 
for example, the Special Eiiq)hasis group pretest score was below the 
comparison group, but their posttest score was higher than the comparison 
group. In terms of grade eq Lvalents, the Special Emphasis group 
gained .9 year's growth. In both cases, there were serious ceiling 
effects on the pretest so that the growth rates are overestimates of 
the true rate* 



It has been common practice in education to expect a 1 moath 
growth rate for each month a student attends school, resulting ixi an 
expected growth rate of 1.0 grade equivalent over the course of a 
school year; Dr. Bjom Karlsen, an author of the SORT, has noted 
that this expectation is unrealistic for all students.^ He presents 
evidence that for students scoring below the 25th percentile with 
respect to the national norms, an average growth of .6 to .7 of a 
grade equivalent per school year would be a more reasonable expecta- 
tion. Therefore, while it may appear that low-scoring groups are 



F. M. Lord, "Elementary Models for Measuring Change," in Problems in 
Measuring Chan^ (C. W. Harris, ed.). Madison, University of Wisconsin 
Press, 1967, p. 37. 

2 

B. Karlsen, "Accountability - A Year's Growth in a Year?," The California 
Reader , Vol. 5, No. 1, January, 1972. 
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losing ground with respect to normal expectations, a program may produce 
educationally significaat results with growth r- .as of less than 1.0 
grade equivalent per school year for students in the lowest quartile. 

Coyari ance Analyses of Below Mean Cohort Groups 
The cc^'ariance analyses for the below mean cohort groups is 
similar to that for the whole grade cohort groups. The analytic 
samples, t:hough, are subsets of the whole grade groups. These subsets 
consist of only those students who had a pretest "comprehension total" 
scaled score below the mean pretest score for the whole grade group. 

Several hazards are associated with the use of ANCOVA for below 
mean cohort groups. These are listed below and readers are advised 
to consider these limitations when reviewing the analytical results 
presented in Section 5 of this report. 

• The proportion of students scoring below the grade mean 

in Special Emphasis and comparison groups may not be equal. 

• The below mean cohort group for both Special Emt^^asis 
and comparison groups exhibit a preponderance of negative 
measurement error at the low end of the distribution. 

Appendix F contains summaries for each site of the covariance 
analyses of balow mean cohort groups for project years 1977-78 and 1978-79. 
The below mean analyses for 1977-79 were not done because sample sizes 
were too small to provide useful results. The tables are in the same 
format as the tables in Appendix E. The importance of these analyses 
is that they address impact for those students for whom the Special 
Emphasis treatment was intended and avoids the problems related to 
ceiling effects since the sturients likely to have encountered the test 
ceiling are not included in the below mean giioups. 

For the below mean group of students, this study will consider 
the average expected growth rate in terms of grade equivalent to be 
.6 years. 
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Trend Analys es for Students Reading 1 or More Years Below Grade 
Level 

A second approach taken to investigate the impact of Special 
Emphasis on the students for whom the Special Emphasis Program had been 
intended to serve was based on an examination of trends in the percentage 
of students who, over the period from the spring 1977 to the spring of 
1979 were reading at a grade equivalent level 1 or more years below 
grade level on the referent year's spring pretest. Students were 
included in this group if their grade equivalent score was 1.0 years 
below "normal expectation." For example, a third grade student would 
be included in this group if his/her grade equivalent score for the 
spring testing was 2.9 or less at the end of the third grade since 
the student would be expected to have grade equivalent score of 3.9. 

Frequencies were tabulated for each spring testing of: 

• The number of students tested for each grade , 

• The number of students reading 1 or more years below grade 
level for each grade. 

From these data, the percent of students reading 1 or more years 
below grade level was calculated. These data are contained in tables 
for each site in Appendix D. An example for one site follows on 
Tables G.9 to G.ll. From Table G.9, it can be seen that overaJ.l 45% 
of the students tested in spring 1977 in the Special Emphasis school 
were reading more than 1 year below grade level. Additional data is 
also presented on Table 3.9 so that trends regarding individual students 
can be examined. For example, for the fourth grade at the Special 
Emphasis school, 53 students were tested in spring 1977, 27, or 51%, of 
whom were reading more than 1 year below grade level. Of the 53 
students tested in spring 1977, 46 were tested in spring 1978—4 of 
whom had been retained in the fourth grade and 42 of whom harl advanced 
to the fifth grade. Of the 42 students who had advanced to the fifth 
grade, 20, or 48%, had been 1 or more years below grade level at the 
end of fourth grade. TWenty-eight, or 67%, were 1 or more years below 
grade level at the end of fifth grade. Of the 20 who were below grade 
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TABLE G.9 

FREQUENCY ANALYSIS OF STUDEinS MORE THAN 1 YEAR 
BELOW GRADE LEVEL IN READING COMPREHENSION 

gro1«et f«tr 1977-78 



Siu: TSBIZ3SB 

School,: Sp««lal Sapiiulj 





CM cod 


»o. >1 yr 
b«lov 


Z Qi coeal 
>1 bolow 






S/A 


K/l 






13 


312 




Z5 


13 


435 




33 


27 


3U 




36 


36 


642 




77 


44 


622 


lOtAL 


314 


141 


432 


School: Co«p«xlJo& 


S?!mC 1977 


Ceado 


7oe«l 
sea4oaea 


Ud. >1 yv 
b«Iov 


2 ot zataX 
>1 7? boXflw 
«Tado 




32 


!I/A 


S/A 




31 


1 


32 




19 


3 


412 




^24 


U 


462 




22 


16 


732 




33 


la 


332 


TOUL 


161 


34 


342 



S?Ri:(C L977 TO S?mS 19^8 


Crado Grado 

Spr n Spr 78 


tocal scudoaei 
euetd AC 

bocii 90incs 


Ho. >1 yx 
bdov grado 

Sot 77 


Mo. >1 
b«low irado 

Spr 78 


So. >1 yr 
bolov jrada 


1 I 
1 2 


2 

3: 


»/A 
5/A 


9/A 
3 


!C/A 
H/A 


2 3 


40 


10 


9 


8 


3 3 
3 4 


1 
27 


1 

u 


a 

i& 


0 
10 


4 4 
4 3 


4 
42 


4 
20 


2 
28 


2 - 
18 


3 3 


3 
42 


3 
24 


3 
26 


3 
23 




$ 


• 3 


3 


3 













Pro1«ct Ti*r 1977''78 





977 ?3 S?RI2rC 197 3 1 


GtMdm Gcadtt 
Spr 77 Spr 78 


I Tscal scudoaea 

euCAd AC 

both polaes 


! Ho. >1 JTT 
I b«iav fr^* 

1 S^r 77 


Sq. >1 tt I Ho. >1 
b«leii prada bolov fradt 

Sor 78 1 ac boch ?ola.'a f 


1 1 
1 2 


4 
22 


H/A 
2t/A 


S/A 


X/A 


2 2 
2 3 


1 
21 


0 
0 


a 
a 


I i 


3 

3 4 


2 
13 


2 
3 


a 

2 


0 
1 


4 4 
4 3 


3 
14 


3 

& 


1 

7 


I i 


3 6 


19 


13 


12 


" i 


S 6 


1 


1 


a 


a 













BEST 



A T.7 A 
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TABLE G.3.0 

FREQUENCY ANALYSIS 0? STUDENTS MORE THAN I YEAR 
BELOW GRADE LE7EL IN READING CONPSEEENSION 

>to1«ce T««r 1978-79 



Ilea: TSn ra szz 

School: SpoelAJL SaptuialJ 



JPRCrC L973 




scudaaea 
CM cad 


balow 




■* OS (!ocai 
>l 7t balav 
«T«da 




45 








43 




142 




30 


10 


20Z 




34 


13 


33X 




32 


33 


SAZ 




33 


34 


66Z 




279 


103 


37X 



37KZKC 1978 TO SJXINC 197 9 


Crada Grada 
SpT 78 Spr 79 


Tocai smdaaca 
caacad ac 

boch 9oloca 


No. >l jr 
baiav grada 

Sor 7<j 


balsv crada 

Sor 79 


y(o. >i rr 

baiov irada 
ae ^oeh ^olacs 


1 I 
I 2 


I 
34 


S/A 
»/A 


!I/A 

0 


!f/A 
S/A 


Z 2 
2 3 


2 
31 




0 
4 


0 
I 


3 3 
3 4 


3 

37 




3 
7 


3 

2 


4 4 
4 3 


3 

23 


U 


2 
15 


, 2 

A 


3 3 
3 6 


3 
14 




3 
3 


3 
3 


6 6 


3 


3 


3 


3 








4 





Fro'tacg Taar I97g^.79 



Siea: TSSWZSStZ 
School; Caopariaoa 



SPJmC 19 73 


Grada 


Tocal 
srodaaca 
;aaeed 


Ho. >1 7T 
balow 
_4rmda 


2 of eacai 
>1 7T balfltf 
trada 




38 


S/A 


5/A 




27 


2 


71 




ZS 


1 


42 




?22 


4 


17X 




17 


10 


39X 




24 




38Z 


tout 


137 


31 


20Z 



TBUXSC 1973 TO 3?mC 1979 { 


Grada Gcads 
3pr 78 Spr 79 


t^cal scudaaca 
;aacad ac 

boeh 90lnca 


>:©. >i 7T 

baXov fTfida 

SST 79 


Ho. >l rr 
balotf rr'^si 
Sor 70 


So.>i7t j 
balow |7ada 

4C boeh noises 1 


1 1 
1 2 


3 

17 


Y/A 
5r/A 


r/A 

0 


S/A j 
S/A 1 


2 3 


ZO 


1 






3 3 
3 4 


1 
23 


0 

1 


0 
5 


0 

I 


4 3 


21 


3 


a 


3 1 


5 6 


18 


U 


9 


9 


S/A 


H/A 


S/A 


5/A 


S/A 
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TABLE G.ll 

FBZQUZNCT ANALYSIS OF STUDENTS READING >fDRS THAN 1 YEAR 
BELOW GSADE LEVEL IN READING COMPREHENSION 1979 



StZ»t TZiOESSZE 
Schoal: Sp«cl«X Zapluati 



S?mG 1979 


Crate 


TouX 


b«Iov 


>l 7T b«iov 




38 








42 


0 


0 




O 


7 


162 




34 


U 


20Z 




ZZ 


20 


601 




20 




43S 


tOtil 


Z30 


47 


20S 



S?Rt!(C 197 9 




touJL 
acQteoCJ 
rtsesd 


•Ho. >I fX 
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S oi eocal 
>1 yr b«iair 
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level initially, 18, or 90%, remained 1 or more years below grade level. 
In addition, 10 students who had not been more than 1 year below grade 
level at the end of the fourth grade were more than 1 year below grade 
level at the end of the fifth grade. Table G.IO shows that for all 
fifth grade students tested in spring 1978, 33, or 64% were 1 or more 
years below grade level. Of those 33 students, however, only 27%, 9 
students, were also tested in spring 1979. The drop in the percent of 
sixth grade students reading more than 1 year below grade level in 
spring 1979 to 45% (see Table G.ll) appears to be due to sample attrition 
rather than a function of program participation. 

Other Outcomes 

In addition to examination of program impact on student reading 
achievement levels, GRC investigated the possibility of outcomes related 
to: 

• Changes in attitudes and/or behaviors of school, staff, 
students, and parents. 

• Residual effects of the Special Emphasis Project within 
the participating school districts and ochools and on the 
project participants, i.e., school staff, students, and 
parents . 

Each of these types of outcomes, is described in the following discussion. 

Changes in Attitudes and/or Behaviors . Responses from teachers, 
students, and parents were examined from each site and school for both 
the 1977-78 and the 1978-79 project years. Teacher perceptions were 
tabulated regarding: 

• Attitudes of students, teachers, and the principal. 

• Reading behaviors of students. 

• Problens resulting from involvement in the Special 
Emphasis Project. 
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Comparisons were made between responses for the project years to 
determine whether teachers' perceptions of changes in (1) the principal's 
attitude toward the reading program, (2) the students' attitudes toward 
reading, or (3) the teachers' attitudes toward reading instruction had 
changed. Similar comparisons were made regarding teachers' perceptions 
of changes in students' behaviors in (1) tha time spent reading in class, 
(2) the time spent reading outside class, and (3) library and/or class- 
room book usage. 

For each project year, teachers were asked to categorise potential 
problem areas, resulting from Special Emphasis as a major problem, a 
minor problem, or not a problem. The types of problems listed on the 
teacher questionnaires differed for teachers in the Special Emphasis 
school and teachers in the comparison school. The tabulated responses 
for each school for each year were compared to examine whether teachers' 
perceptions of the magnitude of the problem had changed during the course 
of the study. 

Responses to the student survey instruments (grade 3 and grades 
4 through 6) were tabulated and analyzed. Comparisons were made between 
the proportion of third grade students in the Special Emphasis school 
and third grade students in the comparison school who responded that 
(1) reading was fun, (2) they read during their free time, (3) they 
enjoyed reading in class, and (4) they read only when they had to. 
Similar comparisons were made for fourth through sixth grade student 
responses on (1) whether they liked to read, (2) whether the students 
thought they read betcer than the previous year, (3) the amount of 
time spent reading outside of school, and (4) the number of books read 
in the past month. 

Responses from the Parent Questionnaires were tabtilated for each 
project year by site and school. Comparisons were made between the pro- 
portion of parents of Special Emphasis school students and parents 
of comparison school students who responded regarding whether (1) their 
child shared books that he/she read with other family members, (2) the 
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school set up parant-teacher conferences to explain their child's 
strengths or r^-^akaesses in reading, and (3) they had worked as a 
volunteer ir th : child's school during the project year. 



Residue! Effects of Special Emphasis , During the close-out inter- 
views conducted during the fall 1979 site visits, GRC attempted to 
identify any residual effects of Special En?>hasis in the policies, 
procedures, or practices of the school district as a whole or within 
the treatment school. Additionally, information was sought on whether 
the project site had considered the project a success in meeting their 
own objectives. Project staff were also queried about perceived changes 
in staff, students, and parents at the Special Emphasis school which would 
extend beyond the study conclusion. 

Complete results of the impact analysis of the Special Emphasis 
Projects are presented in Section 5. 
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ERIC 



GLOSSARY 



The following list contains technical terms used in this final 
report on the Evaluation of Special Eraphaiis and the meaning given to 
each by the authors of this report. 



Analysis of Covariance (ANCOVA) 



Basal 



Ceiling Effect 



Confounding 



Diagnostic-Prescriptive 



DISTAR 



Downshifting 



A statistical technique 'iSed to test 
for differences among two or more 
groups while statistically controlling 
for group differences on variable (s) 
which are relevant to the criterion 
(dependent) variable. 

A basic reading textbook which » in 
addition to readings, may indicate 
skill exercises and a management 
system to aid ths teacher in tracking 
»klll development c 

The situation in which test was so 
aasy that the student was able to 
answer all or almost all the questions 
correctly. 

Thu presence of factors In an experi- 
ment which disturbs or "clouds" the 
determination of the cause and effect 
relationship between treatment and 
outcomes . 

A teaching approach which, by use of 
a testing instrument, first assesses 
the student* 8 strengths and weaknesses 
on specific skills and then adapts 
the content and/or modalities of 
instruction to fit the individual 
student. 

A commercially available set of 
materials for reading instruction 
which provides highly structured 
exercises for developing reading 
skills. 

See Out-of-Level Testing 
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ESAA 



Experimental Contamination 



Flexible 



Floor Effect 



Hawthorne Effect 



John Henry Effect 



Joplin Plan 



The Emergency School Assistance Act 
which provides special funding to 
school districts for local programs 
designed to assist in dejsegregation 
and overcome the educational dis- 
advantages associated with minority- 
group isolation. 

The presencri of unintended influences 
on an experiment which disturbs or 
"clouds" measurement of the cc-use and 
effect relationship. 

A classroom management style of 
teachers who tend to value a learning 
environment which promotes spontaneity, 
student choice of activities and 
groups, aftudent initiated learning, 
objectives, and student assessment of 
activities. 

The situation in wblch the test was 
too difficult for the student result- 
ing in a score at or below the chance 
level* 

A type of experimental contamination 
in which the participants in an ex- 
periment behave differently not as an 
effect of the treatment but because 
they are aware of being observed. 

A type of experimental contamination 
in which a comparison group, like the 
legendary John Henry, attempts to 
work harder to overcoire its com- 
petitor's advantage of additional 
resources . 

An ixxstructional plan for elementary 
schools which allows teachers to 
specialize in one subject area as 
opposed to the traditional self- 
contained classroom in which one 
teacher teaches multiple subjects. 
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Low Achieving 

Out-of-Level Testing 
Placebo 

Precision Teaching 

Raw Score 

Reading Specialist 

Reading Teacher 
Scaled score 



For purposes of this study, a student 
whose expected level of progress on 
a standardized reading test — all 
other things being equal — is .6 years 
grade equivalent rather than the 1 
year progress expected of the typical 
student. 

The use of a test level below the one 
recommended for the student *s grade 
level • 

Literally, a "satisfier." In an 
experimental situation, a pseudo 
treatment (such as an inert pill) 
which leads the comparison or control 
group members to believe that they 
are also receiving the treatment. 

A reading management system employed 
in the Louisiana site^s Title I pro- 
gram which utilizes a machine-scored 
tracking of student performance on 
500 reading subskills. 

The number of questions the student 
answered correctly on a test. 

An individual with a master^s degree 
with a major or specialty in reading 
from an accredited institution of 
higher education, and has success- 
fully completed 3 years of teaching 
experience, which includes reading 
instruction. 

An individual with a bachelor's 
degree who has successfully completed 
a minimum oj: 12 credit hours or the 
equivalent in courses of teaching 
reading at an accredited institution 
of higher education » and has success- 
fully completed 2 years of teaching 
experience which includes reading 
instruction. 

Performance on a single scale which 
cuts across test times and test 
levels . 
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Stanford Diagnostic Reading 
Teat (SDRT) 



Structured 



Ticle I 



Wisconsin Design 



The reading test used in the Evalua- 
tion of Special Emphasis to measure 
change in reading skills, 

A classroom raanagement style of 
teachers who tend to value controls 
over the learning situation such as 
specified assignments, keeping students 
within their sight, having rules for 
talking aloud, allocation of space for 
specific activities, and rules for a 
student's movement within the class- 
room. 

The section of the Elementary 
Secondary Education Act (ESEA) ^ich 
provides funding for compensatory 
instruction for socially and econom- 
ically disadvantaged students. 

A reading management system used in 
the West Virginia site which provides 
highly structured exercises for 
developing reading skills . 



H-5 



